Video coding and video decoding apparatus

ABSTRACT

A video encoding apparatus is provided with a resolution converting section, an encoding section, and a transmitting section. The resolution converting section enlarges or reduces a binary picture which represents the shape of an object. The encoding section encodes a binary picture reduced by the resolution converting section. The reduction ratio used by the resolution converting section is encoded, and the transmitting section transmits this encoded reduction ratio along with encoded data on the binary picture. The amount of encoded data produced from the encoding section is controlled by changing the enlargement/reduction ratio used by the resolution converting section.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a division of application Ser. No.10/262,873, filed on Oct. 3, 2002 now U.S. Pat. No. 6,879,724, which isa division of application Ser. No. 09/382,771, filed on Aug. 25, 1999(now U.S. Pat. No. 6,546,138), which is a division of application Ser.No. 09/069,851, filed Apr. 30, 1998 (now U.S. Pat. No. 6,154,495), whichis a continuation of Ser. No. 08/722,943 filed Sep. 30, 1996, (now U.S.Pat. No. 5,883,678), the contents of each of which is incorporatedherein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a video coding apparatus and a videodecoding apparatus for encoding a video signal at a high efficiency,transmitting and storing the coded signal, and decoding the codedsignal.

2. Description of the Related Art

Generally, a video signal is compression-encoded before beingtransmitted or stored because the signal has an enormous amount ofinformation. To encode a video signal at a high efficiency, a picture oran image of a frame is divided into a plurality of blocks in units of apredetermined number of pixels. Orthogonal transformation is performedfor each block to separate the special frequency of a picture intofrequency components. Each frequency component is obtained as atransform coefficient and encoded.

As one video coding system, a video coding system belonging to acategory called mid-level coding is proposed in J. Y. A. Wang et. al.,“Applying Mid-level Vision Techniques for Video Data Compression andManipulation”, M.I.T. Media Lab. Tech. Report No. 263, February 1994.

In this system, when a picture consists of a background and an object,these background and object are separately encoded.

To separately encode the background and the object, an alpha-map signal(indicating the background by black pixels and the object by whitepixels) which is subsidiary video information representing the shape ofthe object and the position of the object in the frame is necessary. Analpha-map signal of the background can be uniquely obtained from thealpha-map signal of the object.

As methods of efficiently encoding this alpha-map signal, a binary videoencoding method (e.g., MMR (Modified Modified READ) encoding) or a linefigure encoding method (e.g., chain encoding) is used.

Furthermore, to reduce the amount of codes of an alpha-map, it ispossible to use a method (J. Ostermann, “Object-based analysis-synthesiscoding based on the source model of moving rigid 3D objects”, SignalProcess. Image Comm. Vol. 6, No. 2, pp. 143-161, 1994) by which thecontour lines of a shape are approximated by polygons and smoothed byspline curves or a method (Japanese Patent Application No. 5-297133) bywhich an alpha-map is encoded by reducing it and approximated by curveswhen it is enlarged.

In the above system of separately encoding the background and the objectin the frame, the amount of codes is increased by the amount ofalpha-maps compared to the conventional coding method of encoding awhole frame at once. This increase in the alpha-map code amountdecreases the coding efficiency.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a video codingapparatus and a video decoding apparatus capable of efficiently encodingand decoding alpha-map information which is subsidiary video informationrepresenting the shape of an object and the position of the object inthe frame.

According to the present invention, there is provided a binary pictureencoding apparatus comprising a division section for dividing arectangular region containing an object into blocks, each of the blockshaving M×N pixels (M: the number of pixels included in a row array, N:the number of pixels included in a column array), an encoder forencoding the blocks of the rectangular region by a predetermined rule byapplying relative address coding to at least part of the blocks, astorage for storing reproduction values corresponding to a region whichis near each of the blocks, and a decoder for detecting pixels havingdifferent pixel values, the pixels having different pixel values beingreduced in number by detecting the pixels together with reproductionvalues corresponding to the region near each of the blocks.

According to the present invention, there is provided a binary picturedecoding apparatus comprising a decoder for decoding encoded data, whichis obtained by sequentially encoding blocks of an object-includedrectangular region by a predetermined rule, each of the blocks havingM×N pixels (M: the number of pixels included in a row array, N: thenumber of pixels included in a column array), a storage for storingreproduction values corresponding to a region which is near each of theblocks, a detector for detecting pixels having different pixel values,and a decoder for decoding relative addresses associated with the pixelshaving different pixel values, the pixels having different pixel valuesbeing detected together with reproduction values corresponding to theregion near each of the blocks.

Additional objects and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The objectsand advantages of the invention may be realized and obtained by means ofthe instrumentalities and combinations particularly pointed out in theappended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate presently preferred embodiments ofthe invention and, together with the general description given above andthe detailed description of the preferred embodiments given below, serveto explain the principles of the invention.

FIG. 1 is a view for explaining the present invention, which illustratesan example of a video transmission system to which a video codingapparatus and a video decoding apparatus of the present invention areapplied;

FIG. 2 is a view for explaining the present invention, which is a blockdiagram showing a schematic arrangement of the whole coding apparatus ofthe present invention;

FIG. 3 is a view for explaining the present invention, which is a blockdiagram showing a schematic arrangement of the whole decoding apparatusof the present invention;

FIG. 4 is a block diagram showing the arrangement of a conventionalalpha-map encoder;

FIGS. 5A and 5B are views showing an example of a binary pictureresolution conversion circuit;

FIG. 6 is a view for explaining the present invention, which illustratesan encoder of the first embodiment of the present invention;

FIG. 7 is a view for explaining a conventional decoder;

FIG. 8 is a view for explaining the present invention, which illustratesa decoder of the first embodiment of the present invention;

FIGS. 9A to 9D are views for explaining MMR two-dimensional coding;

FIG. 10 is a view showing examples of variable-length codes and examplesof MMR codes used in the present invention;

FIG. 11 is a flow chart for explaining an MMR coding procedure;

FIGS. 12A to 12C are views for explaining the MMR coding procedure;

FIGS. 13A to 13D are views for explaining the present invention, whichillustrate a procedure of encoding in raster order according to themethod of the present invention;

FIGS. 14A and 14B are views for explaining the present invention, whichillustrate an example requiring a vertical pass mode of the method ofthe present invention;

FIGS. 15A to 15C are views for explaining the present invention, whichillustrate the first example of the vertical pass mode;

FIGS. 16A to 16C are views for explaining the present invention, whichillustrate the second example of the vertical pass mode;

FIG. 17 is a view for explaining the present invention, which is a flowchart for explaining a coding procedure when encoding is performed inraster order;

FIG. 18 is a view for explaining the present invention, which is a blockdiagram of a coding/decoding apparatus using an interframe referenceline;

FIGS. 19A and 19B are views for explaining the present invention, whichillustrate intraframe and interframe reference lines;

FIG. 20 is a view for explaining the present invention, which is a flowchart for explaining a coding procedure using an interframe referenceline;

FIG. 21 is a view for explaining the present invention, whichillustrates switching between coding modes of the present invention;

FIG. 22 is a view for explaining the present invention, whichillustrates block line skip of the present invention;

FIG. 23 is a view for explaining the present invention, which is a flowchart for explaining a coding procedure using a NOT CODED mode of thepresent invention;

FIGS. 24A and 24B are views for explaining the present invention, whichillustrate a case where a plurality of reference lines are used in thepresent invention;

FIG. 25 is a view for explaining the present invention, which is a flowchart of a coding procedure when two reference lines are used in thepresent invention;

FIGS. 26A and 26B are views for explaining the present invention, whichillustrate multivalue alpha maps to be applied to the present invention;

FIGS. 27A and 27B are views for explaining the present invention, whichare block diagrams for explaining arrangements to which the multivaluealpha-map coding method of the present invention is applied;

FIG. 28 is a view for explaining the present invention, whichillustrates the second embodiment of the present invention;

FIGS. 29A and 29B are views for explaining the present invention, whichillustrate the third embodiment of the present invention;

FIGS. 30A and 30B are views for explaining the present invention, whichare block diagrams for explaining the third embodiment of the presentinvention;

FIGS. 31A to 31E are views for explaining alpha maps;

FIG. 32 is a view for explaining another example of the presentinvention;

FIG. 33 is a view for explaining the present invention, which illustratethe fourth embodiment of the present invention;

FIG. 34 is a view for explaining the present invention, which is a blockdiagram showing an example of the arrangement of an apparatus forrealizing the fourth embodiment of the present invention;

FIG. 35 is a view for explaining the present invention, whichillustrates macro blocks MB;

FIG. 36 is a view for explaining the fifth embodiment of the presentinvention;

FIGS. 37A and 37B are views for explaining the present invention, whichillustrate the fifth embodiment of the present invention;

FIGS. 38A to 38D are views for explaining the present invention, whichillustrate the sixth embodiment of the present invention;

FIGS. 39A to 39C are views for explaining the present invention, whichillustrate the seventh embodiment of the present invention;

FIGS. 40A and 40B are views for explaining the present invention, whichillustrate the eighth embodiment of the present invention; and

FIGS. 41A to 41C are views for explaining one application of the presentinvention;

FIGS. 42A to 42C are views showing an example of MV detection andencoding of an alpha map, so as to explain the eighth embodiment of thepresent invention;

FIGS. 43A to 43C are views showing an example in which the blockattribute of an alpha map is decomposed into bit planes, so as toexplain the ninth embodiment of the present invention;

FIG. 44 is a view showing an example in which the bit planes of theblock attribute of the alpha map are encoded, so as to explain the ninthembodiment of the present invention;

FIGS. 45A and 45B are views showing examples of the attributeinformation of a certain macro block at time n and at time n-1, so as toexplain the 10th embodiment of the present invention (views showing thecorrelation of the block attributes between the frames of the alphamap);

FIGS. 46A and 46B are views showing an example of changing the size ofthe label at time n-1 in correspondence with the size of the label attime n, so as to explain the 10th embodiment of the present invention;

FIGS. 47A and 47B are views showing interframe encoding and intraframeencoding, so as to explain the 10th embodiment of the present invention;

FIG. 48 is a view showing an example in which encoding is performed inunits of lines, so as to explain the 10th embodiment of the presentinvention;

FIG. 49 is a view showing an example of a variable length code table forencoding each label, so as to explain the 10th embodiment of the presentinvention;

FIGS. 50A and 50B are block diagram showing examples of the arrangementsof a decoding apparatus and a coding apparatus of the present invention,respectively, so as to explain the 10th embodiment of the presentinvention;

FIG. 51 is a block diagram showing a detailed example of a codingapparatus of the present invention using vector quantization, so as toexplain the 11th embodiment of the present invention;

FIG. 52 is a block diagram showing a detailed example of a decodingapparatus of the present invention using vector quantization, so as toexplain the 11th embodiment of the present invention;

FIG. 53 is a block diagram showing the first example of an index tablegenerator 1609 used in the system of the present invention, so as toexplain the 11th embodiment of the present invention;

FIG. 54 is a block diagram showing the second example of the index tablegenerator 1609 used in the system of the present invention, so as toexplain the 11th embodiment of the present invention;

FIG. 55 is a block diagram showing the third example of the index tablegenerator 1609 used in the system of the present invention, so as toexplain the 11th embodiment of the present invention;

FIG. 56 is a block diagram showing a detailed example of a typedetermining device 1616 used in the system of the present invention, soas to explain the 11th embodiment of the present invention;

FIG. 57 is a flow chart showing the flow of the process of the codingapparatus of the 11th embodiment, so as to explain the 11th embodimentof the present invention;

FIG. 58 is a flow chart showing the flow of the process of the decodingapparatus of the 11th embodiment shown in FIG. 52, so as to explain the11th embodiment of the present invention;

FIG. 59 is a view showing an example of an alpha map so as to explainthe 11th embodiment of the present invention;

FIG. 60 is a view showing an example of an intermediate encoded/decodedstate of the alpha map so as to explain the 11th embodiment of thepresent invention;

FIG. 61 is a view showing a reference portion so as to explain the 11thembodiment of the present invention;

FIG. 62 is a view for explaining a reference portion obtained uponredividing a block, so as to explain the 11th embodiment of the presentinvention;

FIG. 63 is a view for explaining “RT” and “RL”, so as to explain the11th embodiment of the present invention;

FIGS. 64A and 64B are views for explaining estimation of the directionsof boundary lines, so as to explain the 11th embodiment of the presentinvention;

FIGS. 65A and 65B are views for explaining an example of calculation ofan evaluation value used in the present invention, so as to explain the11th embodiment of the present invention;

FIG. 66 is a view for explaining a block for determining an errorallowance condition, so as to explain the 11th embodiment of the presentinvention;

FIGS. 67A and 67B are flow charts showing coding shemes of the presentinvention so as to explain the 11th embodiment of the present invention;

FIG. 68 is a flow chart showing the processing algorithm of the typedetermining device 1616 used in the present invention, so as to explainthe 11th embodiment of the present invention;

FIG. 69 is a view for explaining an algorithm used by a vector quantizer1607 shown in FIG. 51, so as to explain the 11th embodiment of thepresent invention;

FIGS. 70A to 70D are views showing examples of index tables using a typeM, and “RT” and “RL” used in the present invention, so as to explain the11th embodiment of the present invention;

FIGS. 71A to 71C are block diagrams showing coding apparatuses of thepresent invention and switching table of the switch section thereof, soas to explain the 11th embodiment of the present invention;

FIGS. 72A and 72B are block diagrams showing decoding apparatuses fordecoding a code generated by the coding apparatuses shown in FIGS. 71Aand 71B, so as to explain the 11th embodiment of the present invention;

FIG. 73 is a view showing an example of a VLC table used in the presentinvention, so as to explain the 11th embodiment of the presentinvention;

FIGS. 74A and 74B are views respectively showing the relationshipbetween changing pixels in encoding in units of blocks and a referencearea for detecting a changing pixel b1, so as to explain the 11thembodiment of the present invention (views showing the relationshipbetween changing pixels in block-based encoding and a reference area,respectively); and

FIG. 75 is a flow chart showing block-based encoding by MMR, so as toexplain the 11th embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention relates to a video coding apparatus and a videodecoding apparatus used in transmitting/receiving apparatuses (A and Bin FIG. 1) in a video transmission system shown in FIG. 1. These videocoding and decoding apparatuses can perform high-efficiency compressionencoding and decoding for an alpha-map signal.

In the present invention, the coding apparatus encodes an alpha-mapsignal while reducing the resolution and multiplexes the obtained codestogether with the reduction ratio information, thereby forming analpha-map signal to be transmitted or stored. Consequently, an alpha-mapsignal can be efficiently encoded.

Also, the decoding apparatus of the present invention decodes thisefficiently encoded alpha-map signal as follows. That is, the decodingapparatus separates the signal into the alpha-map coded components andthe reduction ratio information, decodes the alpha-map coded components,and enlarges the decoded signal to the original resolution in accordancewith the reduction ratio information, thereby restoring the alpha-mapsignal of the original size. This allows easy decoding of a codedpicture using an alpha map.

FIG. 2 is a block diagram of the video coding apparatus according to thepresent invention. As shown in FIG. 2, the video coding apparatus of thepresent invention comprises a subtracter 100, a motion compensationprediction circuit 110, an orthogonal transform circuit 120, a quantizer130, a variable length encoder 140, an inverse quantizer 150, an inverseorthogonal transform circuit 160, an adder 170, a multiplexer 180, andan alpha-map encoder 200.

The alpha-map encoder 200 encodes an input alpha map and outputs theencoded signal as an alpha-map signal to the multiplexer 180. Theencoder 200 also has a function of decoding an alpha-map signal andoutputting the decoded signal as a local decoded signal.

This alpha-map encoder 200 most particularly has a function ofperforming, when encoding an input alpha-map signal, processing ofreducing the resolution at a given reduction ratio (magnification),encoding the alpha-map signal subjected to this resolution reductionprocessing, multiplexing the encoded signal and the reduction ratioinformation (magnification information), and outputting the multiplexedsignal as an alpha-map output signal to the multiplexer 180. As thelocal decoded signal, a signal obtained by performing processing bywhich the signal subjected to the resolution reduction processing isreturned to the original resolution is used.

The subtracter 100 calculates an error signal of a motion compensationprediction signal supplied from the motion compensation predictioncircuit 110 and an input video signal. The orthogonal transform circuit120 transforms the error signal supplied from the subtracter 100 into anorthogonal transform coefficient in accordance with the alpha-mapinformation and outputs the coefficient.

The quantizer 130 quantizes the orthogonal transform coefficientobtained from the orthogonal transform circuit 120. The variable lengthcoder 140 encodes the output from the quantizer 130 and outputs theencoded signal. The multiplexer 180 multiplexes the output encodedsignal from the variable length coder 140 and the alpha-map signal,together with side information such as motion vector information, andoutputs the multiplexed signal as a bit stream.

The inverse quantizer 150 inversely quantizes the output from thequantizer 130. The inverse orthogonal transform circuit 160 performsinverse orthogonal transformation for the output from the inversequantizer 150 on the basis of the alpha-map signal. The adder 170 addsthe output from the inverse orthogonal transform circuit 160 and theprediction signal (motion compensation prediction signal) supplied fromthe motion compensation prediction circuit 110 and outputs the sum tothe subtracter 100.

The motion compensation prediction circuit 110 has a frame memory andoperates on the basis of the local decoded signal supplied from thealpha-map encoder 200, thereby storing signals of an object region andsignals of a background region. The motion compensation predictioncircuit 110 predicts a motion compensation value from the storedobject-region pictures and outputs as a predictive value, and alsopredicts a motion compensation value from the stored background-regionpictures and outputs as a predictive value.

This apparatus with the above configuration is applied with a videosignal and an alpha-map of the video signal.

The alpha-map encoder 200 encodes the input alpha-map signal through aline 20 while reducing the signal at a designated resolution reductionratio (magnification), multiplexes the encoded alpha-map signal togetherwith the resolution reduction ratio information (magnificationinformation), and outputs the multiplexed signal through a line 30.Also, the alpha-map encoder 200 outputs a local decoded signal, which isobtained by decoding the encoded alpha-map signal so as to restore theoriginal resolution, to the orthogonal transform circuit 120, theinverse orthogonal transform circuit 160, and the motion compensationprediction circuit 110 through a line 40.

When encoding an input alpha-map, this alpha-map encoder 200 performsprocessing of reducing the resolution at a given reduction ratio,encodes the alpha-map signal subjected to the resolution reductionprocessing, multiplexes the encoded signal and the reduction ratioinformation, and outputs the multiplexed signal as an alpha-map signalto the multiplexer 180. This allows efficient encoding of an alpha-mapsignal.

As the local decoded signal, a signal obtained by performing processingof restoring the original resolution of the signal subjected to theresolution reduction processing is used. This local decoded signal isoutput to the orthogonal transform circuit 120 and the inverseorthogonal transform circuit 160 through the line 40. This permits theorthogonal transform circuit 120 and the inverse orthogonal transformcircuit 160 to perform the processing by using the alpha-map of theoriginal size.

A video signal is divided into blocks each having a predetermined pixelsize (N×N pixels) and supplied in the order of block positions to thesubtracter 100 through a line 10. The subtracter 100 calculates an errorsignal of this input (video signal) and the prediction signal (theoutput motion compensation prediction signal from the object predictioncircuit 110) and supplies the error signal to the orthogonal transformcircuit 120. The orthogonal transform circuit 120 transforms thesupplied error signal into an orthogonal transform coefficient inaccordance with the alpha-map information supplied through the line 40and supplies the coefficient to the quantizer 130 where the coefficientis quantized. The transform coefficient quantized by the quantizer 130is encoded by the variable length coder 140 and also supplied to theinverse quantizer 150. The transform coefficient is inversely quantizedby the inverse quantizer 150 and inversely transformed by the inverseorthogonal transform circuit 160.

The adder 170 adds the resulting signal and the motion compensationpredictive value supplied from the motion compensation predictioncircuit 110. The output local decoded picture from the adder 170 isstored in the frame memory of the motion compensation prediction circuit110. On the basis of the local decoded signal supplied from thealpha-map encoder 200, the motion compensation prediction circuit 110supplies to the subtracter 100 a motion compensation predictive value ofan object at a timing at which a block in an object region is processedand a motion compensation predictive value of a background portion atother timings. That is, on the basis of the local decoded signal of thealpha-map signal, the motion compensation prediction circuit 110 checkswhich of a video signal of a portion corresponding to a block in theobject or a video signal of a portion corresponding to a block in thebackground is currently input to the subtracter 100. The motioncompensation prediction circuit 110 supplies to the subtracter 100 theobject motion compensation prediction signal in a period during which avideo signal of a portion corresponding to a block in the object isinput and the background motion compensation prediction signal in aperiod during which a video signal of a portion corresponding to a blockin the background is input.

As a consequence, the subtracter 100 calculates the difference betweenthe input video signal and the prediction signal corresponding to aregion in the picture. If the input picture is a region corresponding tothe object, an error signal with respect to the predictive value in thecorresponding position of the object is calculated. If the input pictureis a picture in a region of the background, an error signal with respectto the predictive value corresponding to that background position iscalculated. The calculated error signal is supplied to the orthogonaltransform circuit 120. The orthogonal transform circuit 120 transformsthe supplied error signal into an orthogonal transform coefficient inaccordance with the alpha-map information supplied through the line 40and supplies the coefficient to the quantizer 130 where the coefficientis quantized.

The transform coefficient quantized by the quantizer 130 is encoded bythe variable length coder 140 and supplied to the inverse quantizer 150.The transform coefficient is inversely quantized by the inversequantizer 150, inversely transformed by the inverse orthogonal transformcircuit 160, and supplied to the adder 170. The output signal from theinverse orthogonal transform circuit 160 is added to the predictivevalue supplied to the adder 170 via a predictive value switching circuit500.

The local decoded video signal output from the adder 170 is supplied tothe motion compensation prediction circuit 110. On the basis of thelocal decoded signal of the alpha-map signal, the motion compensationprediction circuit 110 checks which of a signal corresponding to a blockin the object or a signal corresponding to a block in the background iscurrently output from the adder 170. If a signal corresponding to ablock in the object is being output, the circuit 110 operates so as tostore the signal in a frame memory for the object. If a signalcorresponding to a block in the background is being output, the circuit110 operates so as to store the signal in a memory for the background.Consequently, a picture consisting of only object pictures and a pictureconsisting of only background pictures are stored in the respectivememories. The motion compensation prediction circuit 110 can calculate apredictive value by using an object picture and a predictive value of abackground picture by using a picture in the background.

As described above, the alpha-map encoder 200 encodes an input alpha mapand supplies the encoded alpha-map signal to the multiplexer 180 throughthe line 30.

The multiplexer 180 is also supplied with the output transformcoefficient from the variable length coder 140 through the line 40. Themultiplexer 180 multiplexes the coded values of these alpha-map signaland transform coefficient thus supplied, together with side informationsuch as motion vector information, and outputs the multiplexed signalthrough the line 50. The output signal is a coded bit stream as thefinal output of this video coding apparatus.

The foregoing are the configuration and the operation of the codingapparatus. To obtain an error signal of a picture, motion compensationprediction is performed by using an object picture and a backgroundpicture. To this end, the apparatus checks in accordance with an alphamap whether the current block position of a picture being processed is aposition in an object region or a position in a background region. Ifthe current block position of the picture being processed is an objectregion position, the apparatus calculates the error by using apredictive value obtained from the object picture. If the current blockposition of the picture being processed is a background region position,the apparatus calculates the error by using a predictive value obtainedfrom the background picture.

In performing predicting operations for the object and the background,the motion compensation prediction circuit is made hold pictures in therespective corresponding regions, from a picture obtained from theerror, in accordance with the alpha map, and these pictures are used inthe respective predicting operations. Accordingly, optimum motioncompensation prediction can be performed for each of the object and thebackground. This makes high-quality picture compression encoding anddecoding feasible.

Also, in the present invention, an alpha map is encoded while itsresolution is reduced, and the obtained codes and the reduction ratioinformation are together multiplexed to obtain an alpha-map signal to betransmitted or stored. Therefore, the alpha-map signal can beefficiently encoded and this allows efficient encoding of the shapeinformation of the object.

In reproducing the alpha-map signal, the alpha-map coded components andthe reduction ratio information are separated. The alpha-map codedcomponents are decoded and enlarged to the original resolution inaccordance with the reduction ratio information. Consequently, the alphamap of the original size can be restored and this allows easy decodingof a coded picture using an alpha map.

FIG. 3 is a block diagram showing the decoding apparatus of the presentinvention. As shown in FIG. 3, this decoding apparatus comprises ademultiplexer 300, a variable length decoder 310, an inverse quantizer320, an inverse orthogonal transform circuit 330, an adder 340, a motioncompensation prediction circuit 350, and an alpha-map decoder 400.

The demultiplexer 300 separates an input coded bit stream into analpha-map signal and a coded signal of a picture. The alpha-map decoder400 reconstructs an alpha map by decoding the alpha-map signal separatedby the demultiplexer 300. In this embodiment, the alpha-map decoder 400has a function of separating a supplied alpha-map signal into alpha-mapcomponents and reduction ratio information (magnification information),decoding the alpha-map components, enlarging the resolution on the basisof the reduction ratio information, and restoring the alpha map with theoriginal resolution.

The variable length decoder 310 decodes the coded signal of a pictureseparated by the demultiplexer 300. The inverse quantizer 320 returnsthe decoded signal to the original coefficient by performing inversequantization. The inverse orthogonal transform circuit 330 returns thecoefficient to a predictive error signal by performing inverseorthogonal transformation in accordance with the alpha map. The adder340 adds to this predictive error signal a motion compensationpredictive value from the motion compensation prediction circuit 350 andoutputs the sum as a reproduction video signal. This reproduction videosignal is the final output from the decoding apparatus.

The motion compensation prediction circuit 350 stores the reproductionvideo signal output from the adder 340 into a frame memory in accordancewith the alpha map, thereby obtaining an object picture and a backgroundpicture. In addition, the motion compensation prediction circuit 350obtains an object motion compensation prediction signal and a backgroundmotion compensation prediction signal from these stored pictures.

In the decoding apparatus with the above configuration, a coded bitstream is supplied to the demultiplexer 300 through a line 70 andseparated into codes pertaining to an alpha-map signal and variablelength codes of a video signal by separating individual information. Thecodes relating to an alpha-map signal are supplied to the alpha-mapdecoder 400 through a line 80. The variable length codes of a videosignal are supplied to the variable length decoder 310. The alpha-mapdecoder 400 decodes the codes pertaining to an alpha-map signal into thealpha-map signal and outputs the signal to the inverse orthogonaltransform circuit 330 and the motion compensation prediction circuit350. That is, the alpha-map decoder 400 separates the supplied alpha-mapsignal into the alpha-map components and the reduction ratio informationand decodes the alpha-map components. Also, the decoder 400 restores thealpha map with the original resolution by enlarging the resolution ofthe decoded signal on the basis of the reduction ratio information andoutputs the alpha map to the inverse orthogonal transform circuit 330and the motion compensation prediction circuit 350.

Meanwhile, the variable length decoder 310 decodes the codes suppliedfrom the demultiplexer 300 and supplies the decoded codes to the inversequantizer 320 where the codes are inversely quantized. The transformcoefficient obtained by the inverse quantization is inverselytransformed by the inverse orthogonal transform circuit 330, inaccordance with an alpha map supplied through a line 90, and supplied tothe adder 340. The adder 340 adds the signal subjected to the inverseorthogonal transform by the inverse orthogonal transform circuit 330 andthe motion compensation prediction signal supplied from the motioncompensation prediction circuit 350, thereby obtaining a reconstructedpicture.

In the present invention, the coding apparatus encodes an alpha mapwhile reducing the resolution of the map and multiplexes the obtainedcodes together with the reduction ratio information to form an alpha-mapsignal to be transmitted or stored. Accordingly, an alpha-map signal canbe efficiently encoded and this allows efficient encoding of the shapeinformation of an object.

Also, when decoding the alpha-map signal thus compression-encoded with ahigh efficiency, the decoding apparatus separates the signal into thealpha-map coded components and the reduction ratio information, decodesthe alpha-map coded components, and enlarges the decoded signal to theoriginal resolution in accordance with the reduction ratio information.Consequently, the alpha-map of the original size can be restored andthis allows easy decoding of a coded picture using an alpha map.

The important parts in the present invention are the alpha-map encoder200 in the coding apparatus and the alpha-map decoder 400 in thedecoding apparatus, and the characteristic feature of the inventionresides in that these circuits are given a function of reducing andenlarging the resolution at a desired magnification. Therefore, thisfunction will be described in detail below.

That is, the main components of the present invention are the alpha-mapencoder 200 and the alpha-map decoder 400. The rest of the arrangementcan be accomplished by using the technique of a system of coding apicture with an arbitrary shape described in Japanese Patent ApplicationNo. 7-97073 already filed by the present inventors and so a detaileddescription thereof will be omitted.

A practical configuration of the alpha-map encoder 200 as one majorelement of the present invention will be described below with referenceto FIGS. 4 to 6. A practical configuration of the alpha-map decoder 400as another major element of the present invention will be describedbelow with reference to FIGS. 7 and 8.

FIG. 4 shows a method proposed in Japanese Patent Application No.5-297133. In the alpha-map encoder 200, a resolution conversion circuit210 as a means for converting the resolution reduces an alpha-map signalsupplied through the line 20, thereby decreasing the number of samplesto be encoded. The reduced signal is supplied to a binary pictureencoder 220 through a line 21 and encoded by MMR or chain encoding. Theencoded signal is supplied to the multiplexer 180 through the line 30.

The alpha-map signal reduced by the resolution conversion circuit 210 isalso supplied to a resolution conversion circuit 230 through the line21. The signal is enlarged to the number of samples of the originalsignal supplied to the alpha-map encoder 200 through the line 20. Theenlarged signal is output through the line 40.

FIGS. 5A and 5B illustrate an example of the reduction/enlargementconversion by the resolution conversion circuits 210 and 230. Thisconversion will be described below on the basis of literature, Ogamied.: “Image Processing Handbook”, p. 630, Shokodo.

In FIG. 5A, Pex is a pixel position after the conversion and indicates areal-number pixel position as shown. Accordingly, an input signal isdivided into eight regions on the basis of the distances of the signalto integral-number pixel positions A, B, C, and D, and a pixel value IPof Pex is calculated from pixel values IA to ID of A to D by usinglogical expressions shown in FIG. 5B.

The purpose of the invention shown in FIG. 4 is to reduce the amount ofcodes while permitting an error produced when an alpha map is reduced orenlarged. If the reduction/enlargement ratio is fixed, however, it isimpossible to trade off the error of an alpha-map signal for the amountof codes.

FIG. 6 shows the configuration of the alpha-map encoder 200 of thepresent invention. As shown in FIG. 6, the alpha-map encoder 200 of thepresent invention comprises resolution conversion circuits 210 and 230,a binary picture encoder 220, and a multiplexer 240.

The resolution conversion circuit 210 is a conversion circuit forresolution reduction conversion and encodes an alpha map at a reductionratio corresponding to a given enlargement ratio. The resolutionconversion circuit 230 is a conversion circuit for resolutionenlargement conversion and encodes an alpha map at an enlargement ratiocorresponding to the given enlargement ratio.

The resolution conversion circuit 230 returns the alpha map subjected tothe resolution reduction conversion by the resolution conversion circuit210 to the original size. The alpha map returned to its original size bythis resolution conversion circuit 230 is supplied as an alpha-map localdecoded signal to the orthogonal transform circuit 120 and the inverseorthogonal transform circuit 160 through the line 40.

The binary picture encoder 220 performs binary picture encoding for thealpha-map signal subjected to the resolution reduction conversion by theresolution conversion circuit 210 and outputs the encoded signal. Themultiplexer 240 multiplexes the binary picture encoded output andinformation of the given enlargement ratio and outputs the multiplexedsignal.

In the alpha-map encoder 200 with the above arrangement, the resolutionconversion circuit 210 reduction-encodes an input alpha map through theline 20 at a designated enlargement ratio and outputs the encodedalpha-map signal through the line 30. The resolution conversion circuit230 decodes the reduction-encoded alpha-map signal to the originalresolution and outputs the obtained local decoded signal to theorthogonal transform circuit 120 and the inverse orthogonal transformcircuit 160 through the line 40.

That is, the trade-off mentioned above can be accomplished by supplyingsetting information indicating a desired reduction/enlargement ratio tothe alpha-map encoder 200 through a line 60. The reduction/enlargementratio setting information signal supplied through the line 60 issupplied to the resolution conversion circuits 210 and 230 and thebinary picture encoder 220. In this manner the amount of generated codesof an alpha-map signal can be controlled. Also, the multiplexer 240multiplexes the reduction/enlargement ratio code (setting informationsignal) supplied through the line 60 and the encoded alpha-map signaland outputs the multiplexed signal to the line 30. This signal issupplied as the alpha-map coded signal to the multiplexer 180 as thefinal output stage of the video encoding apparatus.

FIG. 7 shows the concept of an alpha-map decoder as a counterpart of thealpha-map encoder shown in FIG. 4. FIG. 8 shows a practical arrangementof the alpha-map encoder 400 of the present invention.

As shown in FIGS. 7 and 8, the alpha-map decoder 400 comprises a binarypicture decoder 410, a resolution conversion circuit 420, and ademultiplexer 430. The demultiplexer 430 demultiplexes an inputalpha-map signal, which is demultiplexed by the demultiplexer 300 of thevideo decoding apparatus, into codes of an alpha-map signal and codes ofa reduction/enlargement ratio. The binary picture decoder 410 returnsthe alpha-map signal codes to the binary picture in accordance with thereduction/enlargement ratio codes demultiplexed by the demultiplexer430. The resolution conversion circuit 420 performs resolutionenlargement conversion for the binary picture in accordance with thereduction/enlargement ratio codes demultiplexed by the demultiplexer 430and outputs the converted signal.

In FIG. 8, codes supplied to the alpha-map decoder 400 through a line 80are separated into codes of an alpha-map signal and codes of areduction/enlargement ratio by the demultiplexer 430. The alpha-mapsignal codes and the reduction/enlargement ratio codes are outputthrough lines 81 and 82.

The binary picture decoder 410 reconstructs the reduced alpha-map signalfrom the alpha-map signal codes supplied through the line 81 and thereduction/enlargement ratio codes supplied through the line 82, andsupplies the reconstructed signal to the resolution conversion circuit420 through a line 83. The resolution conversion circuit 420 reproducesthe alpha-map signal by enlarging the reduced alpha-map signal to theoriginal size in accordance with the reduction/enlargement ratio codessupplied through the line 82, and outputs the reproduced signal throughthe line 90.

In the present invention, binary picture encoding is used as compressionencoding performed for an alpha-map signal. Details of this binarypicture encoding will be described as the second embodiment of thepresent invention with reference to FIGS. 9A to 10. This embodimentrelates to the binary picture encoder 220 in the first embodiment.

FIG. 10 is a view showing the comparison of codes obtained by variablelength encoding used in the present invention and codes obtained bywell-known MMR encoding. That is, FIG. 10 compares MMR codesrepresenting specific state information with variable length codesrepresenting the same state information. For example, P indicates a passmode which is “0001” in MMR encoding and “0000 001” in the presentinvention. V0, V1, V2, V3, V4, and V5 indicate vertical modes: V0indicates the same position in a line below; V1, a shift of one pixel ina line below; V2, a shift of two pixels in a line below; V3, a shift ofthree pixels in a line blow; V4, a shift of four pixels in a line below;and V5, a shift of five pixels in a line below. V0, V1, V2, V3, V4, andV5 are represented by “1”, “01S”, “0000 1S”, “0000 01S”, nocorrespondence, no correspondence, respectively, in MMR encoding, andrepresented by “01”, “1S”, “001S”, “0001 S”, “0000 1S”, “0000 01S”, and“0000 0001S”, respectively, in the present invention. H indicates ahorizontal mode which is “001” in MMR encoding and “0000 1” in thepresent invention. The present invention additionally has an ESC codewhich is represented by “0000 00001”. In FIG. 10, “S” in these codes isa sign bit indicating which of a1 and b1 is left or right.

FIGS. 9A to 9D are views for explaining two-dimensional encoding of abinary picture used in MMR encoding.

The two-dimensional encoding in the second embodiment will be describedby taking encoding of the positions of five changed pixels on areference line and an encoding line, as shown in FIG. 9A, as an example.If the distance between a1 and b1 is three pixels or less, the distanceis encoded in the vertical mode (V). In other cases, the horizontal mode(H) is used.

In FIGS. 9A to 9D, “a0” is a starting changed pixel on the encodingline, and “a1” is a first changed pixel on the right side of “a0” on theencoding line. “a2” is a changed pixel next to “a1” on the encodingline, and “b1” is a first changed pixel on the reference line on theright side of “a0” and having a color opposite to that of “a0”. “b2” isa changed pixel next to “b1” on the reference line. In this example theprocedure of MMR encoding is as follows.

[1] As shown in FIG. 9B, if the changed pixel b2 on the reference lineis on the left side of the first changed pixel a1 on the encoding line,the pass mode (P) which means a pass of pixels of one line is set, andthe position of the starting changed pixel a0 on the encoding line ismoved immediately below b2.

[2] If the positional relationship is as shown in FIG. 9C, the pass modeis not set because the changed pixel b2 is not on the left side of a1.In addition, since the distance between a1 and b1 is three pixels orless, the vertical mode (V) is set, the distance is encoded, and a0 ismoved to the position of a1.

[3] In other cases as in FIG. 9D, the horizontal mode (H) is set, alength a0−a1 and a length a1−a2 are encoded, and a0 is moved to theposition of a2.

Each of the above mode information is encoded by using the variablelength codes shown in FIG. 10, and the run length in the horizontal modeis encoded by MH (Modified Huffman) (Television Society ed., “ImageInformation Compression”, Ohmu K.K.) This is an example of encodingusing MMR encoding.

In the method of this embodiment, on the other hand, if the distancebetween a1 and b1 is M (=integer) pixels or less in the relationshipbetween the reference line and the encoding line shown in FIGS. 9A to9D, the vertical mode (V) is set. If this distance between a1 and b1 isN (=integer: M≧N) pixels or less, the distance is encoded by variablelength encoding. If the distance is larger than N pixels, the distanceis encoded by using an ESC code (escape code) and a fixed length code.

This fixed length code has log₂ (M−N+1) bits if the value of (M−N+1) isa power of 2. FIG. 10 shows an example of variable length codes whenN=5. Also, the number of pixels in the horizontal direction in a reducedpicture of an alpha-map signal to be encoded by a binary picture encoder220 is known. For example, if this number of pixels in the horizontaldirection is “128”, the maximum value of log₂ (M−N+1) is 7 bits, and sothe value of M can be changed by adding 3-bit additional information.

In MMR encoding, the run length is MH-encoded in the horizontal mode,and the run length frequency distribution varies in accordance with thenumber of pixels in the horizontal direction of an alpha-map signal.Accordingly, the run length can also be fixed-length-encoded inaccordance with the number of pixels in the horizontal direction of analpha-map signal (if the number of pixels in the horizontal line is“128”, the run length is fixed-length-encoded by 7 bits).

If the correlation between frames is high in encoding of a motionpicture, the binary picture encoder 220 is constituted by atwo-dimensional encoder 221, a line memory 222, and a frame memory 223as shown in FIG. 28. A picture in the preceding line is held in the linememory 222, and an alpha-map encoded in the preceding frame is stored inthe frame memory 223. When the two-dimensional encoder 221 performsencoding by referring not only to the preceding line stored in the linememory 222 but also to lines in the preceding frame stored in the framememory 223, the encoding efficiency is in some instances raised.

Also, a reference line in the preceding frame can be motion-compensatedby using motion vectors used in the motion compensation predictioncircuits 110 and 350 shown in FIGS. 2 and 3.

In the method of this embodiment as described above, in the relationshipbetween the reference line and the encoding line shown in FIGS. 9A to9D, if the distance between a1 and b1 is M (=integer) pixels or less,the distance is encoded in the vertical mode (V). If this distancebetween a1 and b1 is N (=integer: M≧N) pixels or less, the distance isencoded by using a variable length code. If the distance is larger thanN pixels, the distance is encoded by using an ESC code (escape code) anda fixed length code. Consequently, encoding can be performed at a highercompression ratio than when MMR encoding is used.

Another example by which compression encoding can be performed at ahigher efficiency will be described below.

FIG. 11 is a flow chart showing the procedure of well-known MMR encodingas a binary picture encoding method. That is, the pixel positioninformation of the starting changed pixel a0 on the encoding line isinitialized (S101). The first changed pixel a1 to the right of theposition of a0 on the encoding line is detected (S102). The firstchanged pixel b1 on the reference line on the right side of the position“a0” and having a color opposite to that of a pixel in the position “a0”is detected and the changed pixel b2 next to the position “b1” on thereference line is detected (S103). Whether the pixel positionalrelationship between b2 and a1 is b2<a1 is checked (S104). If b2<a1, thepass mode (P) is set, the pixel position information of a0 is set to thepixel position information of b2 (S105 and S106), and the flow returnsto the processing in step S103.

If it is determined in step S104 that b2<a1 does not hold, whether|a1−b1|≦N (N is a certain threshold) is checked (S107). If |a1−b1|≦N,the vertical mode (V) is set, the pixel position of a0 is moved to thepixel position of a1 (S108 and S109), and the flow advances toprocessing in step S110. In step S110, whether a0 is a positioncorresponding to “WIDTH” (the number of pixels in the direction of widthof a picture) is checked. If NO in step S110, the flow returns to theprocessing in step S102. If it is determined in step S110 that a0 is theposition corresponding to “WIDTH”, whether the end of the picture isreached is checked (S111). If the end of the picture is not reached, theflow returns to the processing in step S101. If it is determined in stepS111 that the end of the picture is reached, the processing iscompleted.

If it is determined in step S107 that |a1−b1|≦N does not hold, a2 isdetected (S112), the horizontal mode (H) is set, the pixel position of“a0” is set to the pixel position of “a2” (S113 and 5114), and the flowadvances to the processing in step S110. In step S110, whether “a0” is“WIDTH” is checked. If NO in step S110, the flow returns to theprocessing in step S102.

As shown in FIG. 12A, “WIDTH” is the number of pixels in one horizontalline in one frame (the number of pixels in one raster scan line). Thatis, the processing of MMR encoding progresses in units of lines; theencoding is performed by executing encoding processing for each rasterscan line.

As in FIG. 12A, an alpha-map signal to which the encoding processing ofthe present invention is applied, i.e., a binary picture fordistinguishing between the object and the background, is in most cases asimple figure in which the number of changing points in each raster scanline is at most 2. When encoding is performed for each raster scan lineas in the case of MMR encoding shown in FIG. 11, although changed pixelsto be encoded are only those in the boundary between the object and thebackground, the pixel in the right end of the frame must also be encodedas a changed pixel. Accordingly, the method is inefficient in respect ofthe amount of compressed codes.

In the method of the present invention herein explained, therefore, “a1”or “b1” is detected in raster scan order, as shown in FIGS. 13A to 13D,rather than in a line. Consequently, only changed pixels in the boundarycan be encoded. When encoding is performed in units of lines as in MMRencoding, “a1” or “b1” is an address from the left end of thecorresponding line. In the method of the present invention, however,encoding is performed by detecting “a1” or “b1” in raster scan order.Accordingly, “a1” and “b1” are defined as follows.a ₁=abs_(—) a ₁−(int)(abs_(—) a ₀/WIDTH)*WIDTHB ₁=abs_(—) B ₁−((int)(abs_(—) a ₀/WIDTH)−1)*WIDTH

In the above equations, abs_a1(abs_b1,abs_a0) is an address in rasterorder from the upper left corner of the frame. “*” means multiplication,and “(int)(x)” means rounding off the digits after the decimal point ofx. As represented by the crosshatched regions in FIGS. 13C and 13D, thereference line is a region of the number of pixels corresponding to“WIDTH” starting from a pixel in the position a0. FIG. 13C shows thereference line of FIG. 13A, and FIG. 13D shows the reference line ofFIG. 13B. In the method of the present invention, therefore, encoding isperformed as shown in FIGS. 14A and 14B by using the pass mode code P,the horizontal mode code H, and run length codes of white and blackpixels. P is the pass mode code contained in a two-dimensional encodingtable. H is the horizontal mode code also contained in thetwo-dimensional encoding table. The white and hatched rectanglesfollowing these codes represent run length codes of white and blackpixels. However, if encoding is performed in raster order as describedabove for a picture shown in FIG. 14A, a run length exceeding the number(WIDTH) of constituent pixels in the horizontal line of the picture isgenerated as shown in FIG. 14B, since there is no changed pixel over aplurality of lines in the picture. In the method of the presentinvention, therefore, to avoid this inconvenience, the vertical passmode code V is additionally prepared as a code for passing lines in thevertical direction.

If the maximum run length exceeds the constituent pixel number WIDTH inthe horizontal direction of a picture, the vertical pass mode (V) isapplied. The vertical pass mode code V designates a pass of lines in thevertical direction. Therefore, even when the run length is larger than avalue equivalent to “WIDTH”, the run length cannot be expressed if itappears in the next line. To avoid this event, an escape code from thehorizontal mode (run length encoding) is prepared. In this vertical passmode, the maximum value of a run length used in the horizontal mode isthe pixel number WIDTH in the horizontal direction. If a run length hasa value equivalent to WIDTH, an escape code from the horizontal mode(run length encoding) is used as a code representing the run length.

FIGS. 15A to 15C illustrate examples of the vertical pass mode. In anexample shown in FIG. 15A, the vertical pass mode is formed by using anescape code from run length encoding and a vertical mode code. In a caselike that shown in FIG. 15B in which a1 appears in a line which jumps awhole line from the line of a0, the length of a white run can beexpressed by using the pass mode even if the run length is larger thanthe constituent pixel number WIDTH in the horizontal direction of apicture. Therefore, no encoding needs to be performed in the verticalpass mode. In an example shown in FIG. 15C, a1 appears in a lineskipping whole three lines from the line of a0. If this is the case, acode (VP) of the vertical pass mode for designating a jump (i.e., apass) of the corresponding number of lines is prepared in a variablelength code table, and encoding is performed by using this vertical passmode code VP. That is, the number of lines to be passed is expressed inthe vertical mode, and information represented by this code VP isequivalent to “horizontal mode (H)+maximum run length”. Note that asshown in FIG. 15C, instead of expressing the number of lines to bepassed in the vertical mode, the address (SP(a1)) of the next changedpixel can be encoded.

In an alpha-map signal to which the encoding method of the presentinvention is applied, i.e., a binary picture for distinguishing betweenthe object and the background, no changed pixels are in many instancespresent in the first several lines as shown in FIG. 16A. Since thevertical pass mode VP can be used in the present invention, for thepicture as shown in FIG. 16A the vertical pass mode is applied from theleading position of a frame as shown in FIG. 16B or 16C. Consequently,the amount of codes can be reduced. In an example shown in FIG. 16B, thenumber of lines to be passed is expressed by using a vertical mode codeV0. In this example, four vertical mode codes V0 are arranged becausethe number of lines to be passed is 4. A line in which a1 appears isrepresented by “H+white run length” by using a white run length from theleading position of the line to a1 and the horizontal mode code H. Inaddition, the line is expressed in the form of“V0”+“V0”+“V0”+“V0”+“H”+“run length code indicating the number of whitepixels”+“run length code indicating the number of black pixels”by arranging black pixels between a1 and a2.

In an example shown in FIG. 16C, the address (SP(a1)) of the firstchanged pixel in the frame is encoded. A line is expressed in the formof “SP(a1)+run length code indicating the number of black pixels”.Therefore, high-efficiency compression encoding can be performed byapplying this method to encoding of an alpha-map signal.

In the above examples, (a1−a0) and (a2−a1) are run-length-encoded in thehorizontal mode. This merely succeeds the expression method in thehorizontal mode of MMR. Therefore, the present invention proposes anencoding system in which if only (a1−a0) can be run-length-encoded inthe horizontal mode and a2 can be encoded in another mode (e.g., thevertical mode), this a2 is encoded in another method.

FIG. 17 is a flow chart for explaining an encoding procedure when thissystem is applied. In this processing, the pixel position information ofthe starting changed pixel a0 on the encoding line is initialized(S201). The first changed pixel a1 to the right of the position “a0” onthe encoding line is detected (S202). The first changed pixel b1 on thereference line on the right side of the position “a0” and having a coloropposite to that of a pixel in the position “a0” is detected and thechanged pixel b2 appearing next to the position “b1” on the referenceline is detected (S203). Whether b1 is detected is checked (S204). If b1is detected, whether the number of pixels between a0 and a1 is smallerthan 2*WIDTH is checked (S205). If the number of pixels is smaller than2*WIDTH, whether b2<a1 is checked (S206). If b2<a1, the pass mode (P) isset, the pixel position information of a0 is set to the pixel positioninformation of b2 (S207 and S208), and the flow returns to theprocessing in step S203.

On the other hand, if it is determined in step S206 that b2<a1 does nothold, whether |a1−b1|≦9 is checked (S209). If |a1−b1|≦9, the verticalmode (V) is set, the pixel position of a0 is set to the pixel positionof a1 (S210 and S211), and the flow advances to processing in step S212.In step S212, whether the end of the picture is reached is checked. Ifthe end of the picture is reached, the processing is completed. If theend of the picture is not reached, the flow returns to the processing instep S202.

If it is determined in step S209 that |a1−b1|≦9 does not hold, a2 isdetected, and whether the number of pixels between a1 and a2 is smallerthan the horizontal constituent pixel number “WIDTH” of the picture ischecked (S214). If YES in step S214, the vertical mode is set (S215), a0is set to a2 (S216), and the flow advances to the determinationprocessing in step S212.

If it is determined in step S214 that the number of pixels between a1and a2 is not smaller than the horizontal constituent pixel number“WIDTH” of the picture, the vertical pass mode is set (S217), a0 is setto a2 (S218), and the flow advances to the determination processing instep S212.

If it is determined in step S205 that the number of pixels between a0and a1 is not smaller than 2*WIDTH, a2 is detected (S219), the verticalpass mode is set (S217), and a0 is set to a2 (S218). Thereafter, theflow advances to the determination processing in step S212.Consequently, an encoding system is realized in which if only (a1−a0)can be run-length-encoded in the horizontal mode and a2 can be encodedin another mode (e.g., the vertical mode), this a2 is encoded in anothermode.

A practical example in which lines in a preceding frame are used asreference lines and the encoding processing efficiency is improved byusing the correlation between frames will be described below.

FIG. 18 is a block diagram of a coding/decoding apparatus according tothe present invention. In FIG. 18, an encoder/decoder 2000 outputs codedpicture data and decodes and outputs input coded picture data. A linememory 2100 holds picture information in units of lines eachcorresponding to one raster scan. That is, the line memory 2100 holdspicture information of intraframe reference lines and pictureinformation of interframe reference lines. Reference numeral 2200denotes a selector; 2300 a and 2300 b, frame memories for holding framepictures; and 2400, a motion compensation prediction circuit.

The frame memories 2300 a and 2300 b hold picture data of the currentframes. The motion compensation prediction circuit 2400 performs motioncompensation prediction for the picture data from the frame memory 2300b and outputs the picture data subjected to the motion compensationprediction.

In accordance with an output mode switch signal from the encoder/decoder2000, the selector 2200 selects one of the output picture data from themotion compensation prediction circuit 2400 and the picture data fromthe frame memory 2300 a and outputs the selected data to the line memory2100. The line memory 2100 holds the picture data obtained via theselector 2200 in units of lines and transfers the data to theencoder/decoder 2000. The encoder/decoder 2000 encodes or decodes thispicture data in units of lines.

In this system with the above arrangement, the encoder/decoder 2000encodes input picture information in raster scan order while referringto the contents of the line memory 2100 and outputs the encodedinformation from an output OUT. Also, the encoder/decoder 2100 decodescoded information and stores the decoded information in the framememories 2300 a and 2300 b. The decoded picture information in the framememories 2300 a and 2300 b is read out to the selector 2200 or to themotion compensation prediction circuit 2400 where the information issubjected to motion compensation prediction and then supplied to theselector 2200.

Inputs to the selector 2200 are switched in accordance with a modeswitch signal (intraframe/interframe) supplied from the encoder/decoder2000 through a line 10. The picture information is supplied from theframe memories 2300 a and 2300 b to the line memory 2100 via theselector 2200. Consequently, the line memory 2100 sequentially storesintraframe reference lines or interframe reference lines selectivelyinput in accordance with the mode switch signal (intraframe/interframe).

The frame memories 2300 a and 2300 b store the decoded pixel values of aframe of interest and the pixel values of a decoded reference frameobtained by encoding/decoding processing by the encoder/decoder 2000.Note that the motion-compensated signal obtained by the motioncompensation prediction circuit 2400 can also be used as the interframereference line.

Crosshatched portions in FIGS. 19A and 19B indicate examples ofintraframe and interframe reference lines when encoding is performed inraster order. FIG. 19A shows an intraframe reference line which will bereferred to as “ABOVE LINE” hereinafter. FIG. 19B shows an interframereference line which is set as illustrated with respect to the same a0as in a reference frame or an address a0 after motion compensation. Thisinterframe reference line will be referred to as “PREVIOUS LINE”hereinafter.

Mode information for switching reference lines is separately encoded inunits of block lines consisting of a plurality of lines by theencoder/decoder 2000.

FIG. 20 is a flow chart showing the encoding procedure of thisembodiment. The encoder/decoder 2000 first initializes the pixelposition information of the starting changed pixel a0 on the encodingline (S301) and then checks whether the mode of the line to which thestarting pixel a0 belongs is an intraframe mode (INTRA) (S302). If themode is the intraframe mode (INTRA), “ABOVE LINE” is read into the linememory 2100 (S302). If the mode is not the intraframe mode (INTRA),“PREVIOUS LINE” is read into the line memory 2100 in FIG. 18 (S309).

Subsequently, the encoder/decoder 2000 detects a1 (S304), detects b1 andb2 (S305), and checks whether the pixel positional relationship betweenb2 and a1 is b2>a1 (S306). If b2<a1, the encoder/decoder 2000 sets thepass mode (P) and sets the pixel position information of a0 to the pixelposition information of b2 (S307 and S308), and the flow returns to theprocessing in step S304.

If it is determined in step S306 that the pixel positional relationshipbetween b2 and a1 is not b2<a1, the encoder/decoder 2000 checks whether|a1−b1|≦N (N is a certain threshold) (S310). If |a1−b1|≦N, theencoder/decoder 2000 sets the vertical mode (V) and sets the pixelposition of a0 in the pixel position of a1 (S311 and S312), and the flowadvances to processing in step S313. In step S313, the encoder/decoder2000 checks whether a0 is a position corresponding to “WIDTH” (thenumber of pixels in the direction of width of a picture). If NO in stepS313, the flow returns to the processing in step S304. If it isdetermined in step S313 that a0 is a position corresponding to “WIDTH”,the encoder/decoder 2000 checks whether the end of the picture isreached (S314). If the end of the picture is not reached, the flowreturns to the processing in step S301. If it is determined in step S314that the end of the picture is reached, the encoder/decoder 2000completes the processing.

If it is determined in step S310 that |a1−b1|≦N does not hold, theencoder/decoder 2000 detects a2 (S315), sets the horizontal mode (H),and sets the pixel position of “a0” to the pixel position of “a2” (S316and S317). Thereafter, the flow advances to the processing in step S313.

That is, in the above procedure, if the mode of the line to which thestarting pixel a0 belongs is the intraframe mode (INTRA), “ABOVE LINE”is read into the line memory 2100 shown in FIG. 18. If the mode is aninterframe mode (INTER), “PREVIOUS LINE” is read into the line memory2100. If “PREVIOUS LINE” as the reference line is exactly the same asthe encoding line or the error between the lines is very small, “NOTCODED” is performed, i.e., the signal of the reference line is directlycopied without encoding the encoding line. Since the signal of thereference line is directly copied without encoding the encoding line if“PREVIOUS LINE” as the reference line is exactly the same as theencoding line or the error between the lines is very small, the amountof generated codes can be reduced.

FIG. 21 shows an example of mode switching performed in units of blocklines for an alpha map of an image of a person when the above system isused. A block line indicates a block constituted by a plurality ofadjacent lines. Block lines 0 and 1 occupied by a portion correspondingto the top of the head and its vicinity are in the “INTRA” line mode.Block lines 2 to 4 occupied by a portion corresponding to the face arein the “NOT CODED” line mode since the differences between the lines aresmall. Block lines 5 to 8 occupied by a portion corresponding to theshoulders and the chest and their vicinities are in the “INTRA” linemode.

FIG. 22 explains a practical example in which encoding of block lines inthe “NOT CODED” mode is skipped when encoding is performed in rasterorder.

In the present invention, mode switching is performed in accordance withthe attribute (“INTRA”/“INTER”/“NOT CODED”) of a line to which thestarting pixel a0 belongs. However, a1 does not necessarily exist on thesame line as a0 when encoding is performed in raster order. Accordingly,whether a1 is on the same line as a0 in decoding is unknown.

As shown in FIG. 22, therefore, when a0 is the last changed pixel on theblock line of interest and the mode of the next block line is the “NOTCODED” (no encoding), the processing skips to the next block line in a“CODED” (encoding) mode by using a skip code SK. The first pixel on theblock line to which the processing skipped is set as new a0, and allregions in this block line are encoded. Assume that a0 is present on ablock line B1, the mode of the block line B1 is “INTER”, three blocklines B2 to B4 in the “NOT CODED” mode follow the block line B1, and ablock line B5 in the “INTER” mode follows the block line B4. In thiscase a0 is moved as new a0 to the leading position of the block line B5,and the processing skips from a0 to new a0 by using the code SK, therebysetting all of the block lines B1 to B4 in the “CODED” mode, i.e.,encoding these block lines. A variable length code of the code SK isdesigned together with variable length codes of “verticalmode”/“horizontal mode”/“pass mode”.

FIG. 23 is a flow chart showing the encoding procedure described above,in which the portion enclosed within the dotted lines in FIG. 17 isaltered.

The pixel position information of the starting changed pixel a0 on theencoding line is initialized (S201). Whether the mode of the line towhich the starting pixel a0 belongs is the intraframe (INTRA) mode ischecked (S1201). If the mode is the intraframe (INTRA) mode, “ABOVELINE” is read into the line memory 2100 shown in FIG. 18 (S1202). If themode is not the intraframe (INTRA) mode, “PREVIOUS LINE” is read intothe line memory 2100 (S1203). Subsequently, whether the line to which a0belongs is “NOT CODED LINE”, i.e., a line not to be encoded, is checked(S1204). If the line is a line not to be encoded, the flow advances tothe processing in step S201. If the line is a line to be encoded, a1 isdetected (S202), b1 and b2 are detected (S203), and the flow advances tothe processing in step S204.

As described above, encoded signals in the preceding frame are decodedand stored, and whether the region of a picture being encodedapproximates to the state of a picture in an encoded region is checkedby referring to the signals of the preceding frame. If the region beingencoded approximates to the encoded region, the picture in the region isnot encoded. Instead, signals in the decoded frame are copied to theframe being encoded, the copied portion is skipped, and the region to beencoded next is encoded. Consequently, the processing efficiency can beimproved because encoding of the copied portion is skipped.

A practical example in which the amount of codes to be generated isreduced by improving the performance of prediction by using a pluralityof reference lines will be described below.

FIGS. 24A and 24B are views for explaining the relationship between theencoding line and the reference line in the present invention. Beforethe explanation, c1 and c2 are redefined as follows.

-   -   c1: the first changed pixel on the right side of a0 and having a        color opposite to that of a0    -   c2: the next changed pixel of c1

In the present invention, when a1 is encoded the displacements of b1 anda1 are predicted from the displacements of c1 and b1. diff obtained bythe following equation is encoded in the vertical mode.diff=b ₁ −a ₁ +f(b ₁ −c ₁)

In the above equation, f(x) is a prediction function for estimating thedisplacements of b1 and a1. Also, the following equations are examplesof prediction functions by which the predictive value is set to 0 whenthe absolute values of the displacements of c1 and b1 are smaller than athreshold th, in order to prevent a decrease in the predictionefficiency resulting from micro-noise.

f(x) = 0 (abs(x) < th) f(x) = sign(x) (abs(x) ≧ th) sign(x) = −1 (x = 0)sign(x) = 0 (x = 0) sign(x) = 1 (x > 0)

Note that if c2 is closer to the left end than b1 or if abs(b1−c1) islarger than a certain threshold, encoding is performed in the regularvertical mode.

FIG. 25 is a flow chart showing the encoding procedure of this practicalexample. The first vertical mode is a conventional vertical mode, andthe second vertical mode is a vertical mode using two reference lines,which is a new mode used by the present invention.

In this processing, the pixel position information of the startingchanged pixel a0 on the encoding line is initialized (S401). The firstchanged pixel a1 to the right of the position “a0” on the encoding lineis detected (S402). The first changed pixel b1 on the reference line onthe right side of the position “a0” and having a color opposite to thatof a pixel in the position “a0” is detected and the changed pixel b2appearing next to the position “b1” on the reference line is detected(S403). Whether b1 is smaller than a1 is checked (S404). If b1 issmaller than a1, the pass mode (P) is set (S405), the pixel positioninformation of a0 is set to the pixel position information of b2 (S406),and the flow returns to the processing in step S403.

If it is determined in step S405 that b1 is not smaller than a1, c1 andc2 are detected (S407), and whether c2 is smaller than b1 is checked(S408). If c2 is smaller than b1, whether |a1−b1|≦N is checked (S409).If |a1−b1|≦N, the first vertical mode (V) is set (S410), the pixelposition of a0 is set to the pixel position of a1 (S411), and the flowadvances to processing in step S412.

In step S412, whether the position of a0 corresponds to the value ofWIDTH as the number of pixels in the horizontal direction is checked. IfNO in step S412, the flow returns to the processing in step S402. If YESin step S412, the flow advances to step S413 to check whether the end ofthe picture is reached. If the end of the picture is reached, theprocessing is completed. If the end of the picture is not reached, theflow returns to the processing in step S401.

On the other hand, if it is determined in step S408 that c2<b1 does nothold, whether |diff|≦N is checked (5418). If NO in step 5418, a2 isdetected (5414), the horizontal mode is set (S415), and a0 is set to a2(S416). The flow then advances to the processing in step S412. If it isdetermined in step S418 that |diff|≦N, the second vertical mode is set(S419), a0 is set to a2 (S420), and the flow advances to the processingin step S412.

On the other hand, if it is determined in step S409 that |a1−b1|≦N doesnot hold, a2 is detected (S414), the horizontal mode is set (S415), anda0 is set to a2 (S417). The flow then advances to the processing in stepS412.

By the above processing, the performance of prediction can be improvedby using a plurality of reference lines. The amount of codes to begenerated can be reduced by this improvement of the predictionperformance.

As one application of high-efficiency compression encoding according tothe method of the present invention, a practical example of encoding ofmultivalue alpha maps, rather than the binary ones as described above,will be described below. FIGS. 26A and 26B are views for explainingmultivalue alpha maps.

FIG. 26A shows an alpha map in which, in order to prevent discontinuityin the boundary when the object and the background are synthesized, theweighting of the synthesis is expressed by multiple values. FIG. 26Bshows an alpha map when a portion of a caption is semitransparentlysynthesized (semitransparent superposition).

Assuming the signal of the object is So, the signal of the background isSb, and the value of weighting (Alpha Value) is a, a synthetic signal isrepresented by an equation below. In this equation Alpha Value isexpressed by 8 bits.Sc=((255−a)*Sb+So)/255

To encode this alpha map, as shown in FIG. 27A, shape information(Shape) representing whether the value of the alpha map is 0 and alphavalue information (Alpha Value) which is gray scale information(gradation information) of each pixel in the alpha map are separatelyencoded. That is, as illustrated in FIG. 27B, the shape informationShape is supplied to a shape coding unit 2500 for practicing the binarypicture coding method of the present invention. There the shapeinformation Shape is encoded by the binary picture coding method of thepresent invention. In accordance with the reproduction signal of theinformation Shape, an alpha value coding unit 2600 for encoding amultivalue picture encodes the alpha value information Alpha Value.

In this manner it is possible to encode multivalue alpha maps, ratherthan binary ones.

As the third embodiment of the present invention, a code amount reducingtechnique when the region occupied by the object in a whole frame isvery small will be described below with reference to FIGS. 29A to 30B.

In a case where the region occupied by the object in a while frame isvery small as shown in FIG. 29A, the amount of codes is sometimesreduced by encoding an alpha-map signal of the small region containingthe object, as shown in FIG. 29B, rather than an alpha-map signal of thewhole frame. If this is the case, the size of the small region and thepositional relationship in the frame must be known. Therefore, theposition address of an upper left corner S of a small region, whichrepresents the position of the small region, and the dimensions (h, v)of the small region in the (horizontal, vertical) directions areadditionally encoded as additional information. Furthermore, to reducethe amount of codes of S and (h, v), the small region is so set as to bean integral multiple of a block which is a processing unit of encodingenclosed within the broken lines in FIG. 29A. Consequently, S and (h, v)can be expressed by block addresses.

FIGS. 30A and 30B are block diagrams for explaining the flow of theabove processing. FIG. 30A is a block diagram of a transmitter, and FIG.30B is a block diagram of a receiver.

The transmitter consists of an object region detector 500, an alpha-mapencoder 200, and a multiplexer 510. The object region detector 500detects the region of the object from an alpha map, i.e., detects thealpha-map signal of the small region and the values of S and (h, v).

The alpha-map encoder 200 encodes the alpha map of the small region.Details of the encoder 200 have already been described. The multiplexer510 multiplexes the encoded alpha-map and the output values of S and (h,v) from the object region detector 500 and outputs the multiplexedsignal.

The receiver comprises a demultiplexer 520, an alpha-map decoder 400,and an alpha-map restoration circuit 530. The demultiplexer 520demultiplexes the bit stream into the alpha-map signal of the smallregion and the coded components of the values of S and (h, v). Thealpha-map decoder 400 decodes the alpha-map signal of the small regionto obtain the alpha map of the original size. The alpha-map restorationcircuit 530 restores the values of S and (h, v) from the codedcomponents of the values of S and (h, v).

In the above configuration, an alpha-map signal of a whole frame issupplied to the object region detector 500 through a line 20. Thedetector 500 supplies an alpha-map signal of the small region as shownin FIG. 29B to the alpha-map encoder 200 through a line 22. Also, thedetector 500 encodes the values of S and (h, v) and supplies the encodedvalues to the alpha-map encoder 200 and the multiplexer 510 through aline 23.

The multiplexer 510 multiplexes the encoded alpha-map signal of thesmall region supplied through a line 24 and the encoded values of S and(h, v) supplied through the line 23 and outputs the multiplexed signalthrough a line 30.

Meanwhile, the codes supplied to the demultiplexer 520 through a line 80are demultiplexed into codes pertaining to the alpha-map signal of thesmall region and codes pertaining to S and (h, v), and these codes areoutput through lines 84 and 86, respectively. The alpha-map restorationcircuit 530 restores the alpha-map signal of the whole frame from thereconstructed alpha-map signal of the small region supplied through aline 85 and the values of S and (h, v) supplied through the line 86 andoutputs the restored signal through a line 90.

As a result, when the region occupied by the object in a whole frame isvery small as shown in FIG. 29A, the amount of codes can be reduced byencoding an alpha-map signal of the small region containing the objectas shown in FIG. 29B, rather than an alpha-map signal of the wholeframe.

As the fourth embodiment, a technique which smooths an obliquediscontinuity occurring due to sampling conversion(enlargement/reduction conversion) will be described below withreference to FIGS. 4, 33A and 33B, and 34.

When a binary picture is repeatedly reduced and enlarged, oblique linesor curved lines easily loose their smoothness. Since an alpha-map signalis binary picture information, the signal readily brings about thisphenomenon when repeatedly reduced and enlarged. In addition, analpha-map signal is used to extract or identify a portion of interest ina frame. Therefore, the loss of smoothness leads to degradation of imagequality. Accordingly, a technique by which this problem of the loss ofsmoothness is eliminated is necessary.

This embodiment relates to a binary picture processing method whichsmooths an oblique discontinuity occurring due to sampling conversion(enlargement/reduction conversion) in the arrangement shown in FIG. 4.

FIGS. 33A and 33B are views for explaining smoothing processing. FIG.33A shows a binary picture of an original size, and FIG. 33B shows abinary picture obtained by reducing the picture in FIG. 33A. In FIGS.33A and 33B, an object region is indicated by full circles and abackground region is indicated by open circles.

In this embodiment, to smooth an oblique discontinuity occurring when aresolution conversion circuit 210 or a resolution conversion circuit 230performs sampling conversion (enlargement/reduction conversion) in theconfiguration shown in FIG. 4, the upper, lower, left, and right pixels,i.e., the adjacent pixels, of each pixel (open circle) in the backgroundregion are checked. If two or more of these adjacent pixels are pixels(full circles) in the object region, the pixel of interest in thebackground region is incorporated into the object region.

That is, assume that the pixel to be checked in the background region iseither of pixels in positions indicated by double circles in FIG. 33B.In this case two adjacent pixels are pixels (full circles) in the objectregion. Therefore, the pixel (i.e., the pixel to be checked) in theposition indicated by the double circle is changed into a full-circlepixel, i.e., a pixel in the object region. Assuming a full-circle pixelis “1” and an open-circle pixel is “0”, the pixel (pixel value “0”) inthe position indicated by the double circle is replaced by a pixel value“1”.

More specifically, as illustrated FIG. 34, two frame memories 621 and622 are prepared as devices for performing the above picture processing,and binary picture data to be smoothed is held in these frame memories621 and 622. One frame memory is used as a memory for holding thepicture to be checked, and the other is used as a working memory. Acontroller 623 controls these frame memories 621 and 622 as follows andperforms arithmetic processing as follows by using the contents held inthe frame memories 621 and 622.

When binary picture data is input, the controller 623 stores this binarypicture data in the holding memory for a picture to be checked and theworking memory (S1). The controller 623 sets each pixel of the pictureheld in the holding memory for the picture to be checked, as the pixelto be checked, and checks the values of four adjacent pixels of thatpixel (S2). The controller 623 checks whether the value of the pixel tobe checked is “0” and two or more of the four adjacent pixels have avalue “1” (S3). If two or more adjacent pixels have “1”, the controller623 rewrites the value of the pixel to be checked by “1” (S4). Thisrewrite operation is done by replacing the value in the correspondingpixel position in the working memory with “1”.

When completely processing all pixels, the controller 623 reads out thecorrected binary picture data from the working memory (S5) and outputsthe data as smoothed binary picture data. When this processing iscompleted, the binary picture data which has lost its smoothnessrestores the smoothness of the contour. For binary picture data whosesmoothness is largely lost, the above processing is repeated a pluralityof number of times. That is, the controller 623 copies the correctedbinary picture data stored in the working memory to the holding memoryfor the picture to be checked (S6), and again performs the processingfrom step S2. When the ratio and the number of times of compression andenlargement are determined, the degree of the loss of smoothness can beknown in the system. Therefore, the controller 623 repeats the aboveprocessing by determining an appropriate repetitive number in accordancewith the situation, reads out binary picture data from the workingmemory as the processed binary picture data, and outputs the readoutdata as the final processed data.

As a consequence, even binary picture data whose smoothness is largelylost can be corrected to have a smooth contour. Accordingly, when thepicture processing means shown in FIG. 34 is provided in the outputstage of the resolution conversion circuit 210 in the configurationshown in FIG. 4, binary-picture data with a smooth contour can besupplied to the subsequent stage.

Although various examples have been described above, the gist of theembodiments is that the resolution of an alpha map required to realizeobject scalability is reduced when the alpha map is encoded, and theobtained codes and the reduction ratio information are togethermultiplexed to form an alpha-map signal to be transmitted or stored.Consequently, the alpha-map signal can be efficiently encoded and thisallows efficient encoding of the shape information of the object.

In reproducing the alpha-map signal, the coded components of the alphamap and the reduction ratio information are separated. The codedcomponents of the alpha map are decoded and enlarged to the originalresolution in accordance with the reduction ratio information.Accordingly, the alpha map of the original size can be restored. Thisallows easy decoding of a coded picture using an alpha map.

In the present invention, the processing can be performed in units ofblock lines. Therefore, as shown in FIG. 32, codes of alpha maps can betransmitted in units of block lines and decoded in units of block lineson the receiver side.

That is, general MMR detects changed pixels only in horizontal lines ofa picture. In the first to fourth embodiments, on the other hand, MMR isused but changed pixels of a picture are detected across a plurality oflines in raster scan order. Accordingly, the processing can be performedin units of block lines. Consequently, as shown in FIG. 32, codes ofalpha maps can be transmitted in units of block lines and decoded inunits of block lines on the receiver side.

Each of the above embodiments is a method of encoding a whole frame orindividual block lines in encoding of an alpha map necessary to realizeobject scalability which is a function of a coding system capable ofreproducing (reconstructing) a picture in units of partial images witharbitrary shapes. That is, each embodiment is a method of encoding analpha map expressed by binary pictures by using a coding method based onMMR (Modified Modified READ) which is a coding system of FAX. MMR isbasically a coding system whose unit is a line.

On the other hand, in the existing picture coding systems such as MPEGwhich is a standard coding system for motion pictures, a generalapproach is to divide a whole frame into macro blocks MB each consistingof 16×16 pixels and perform encoding in units of macro blocks MB.Therefore, in these systems it is desirable to perform encoding of alphamaps in units of macro blocks MB. However, the macro block MB is aportion of a frame. Accordingly, if the macro blocks MB are encoded oneafter another on the basis of MMR which is a coding system whose unit isa line, the coding efficiency may be decreased.

A coding technique, therefore, capable of efficiently performingencoding and decoding in units of macro blocks will be described below.

As the fifth embodiment, the first method of performing encoding anddecoding in units of macro blocks according to the present inventionwill be described below with reference to FIGS. 35, 36, and 37A and 37B.System configurations required in this embodiment can be basically thesame as the configurations shown in FIGS. 2 and 3. It is only necessaryto design the system such that encoding is performed by the alpha-mapencoder 200 shown in FIG. 2 and decoding is performed by the alpha-mapdecoder 400 shown in FIG. 3.

FIG. 35 shows a frame of an alpha map divided into macro blocks MB eachconstructed by a predetermined number of pixels, i.e., 16×16 pixels. InFIG. 35, the square measures indicate the boundaries between the blocks,and each measure is the macro block MB.

Since an alpha map indicates information of the object by using binarynumbers in units of pixels, each pixel is black or white. Therefore, asshown in FIG. 35, the contents of the macro blocks MB in an alpha-mapframe are classified into three categories, “all_white”, “all_black”,and “others”.

In the case of a frame as shown in FIG. 35 which is an alpha map of animage of a person, the background is “white” and the person is “black”.The macro blocks MB are constructed by macro blocks MBwh indicating thebackground, macro blocks MBbk indicating the person, and macro blocksMBot containing both the background and the person. Portions requiringencoding are the macro blocks MBot. As is apparent from FIG. 35, themacro blocks MBot are macro blocks containing the contour of an objectOJ. That is, it is only necessary to apply the MMR-based coding methodto macro blocks shown in FIG. 36. The macro blocks MBot exist in theregion of the contour of the person and contain both the background andthe person.

When the methods of the first to fourth embodiments are applied to macroblocks MB as shown in FIGS. 37A and 37B, changed pixels detected arethose in positions indicated by full circles in FIG. 37A. In thesubsequent drawings, each macro block MB is illustrated as a blockconstructed by 8×8 pixels for the sake of simplicity.

When the macro blocks MB are encoded in raster scan order from the upperleft corner of a frame and decoded in raster scan order after beingreceived, a pixel group (“top reference”) in contact with the upper edgeof a macro block MB being encoded or decoded and a pixel group (“leftreference”) in contact with the left edge of the macro block MB haveknown values on both of the transmitter and the receiver sides as shownin FIG. 37B. That is, since the processing is performed in raster scanorder, “top reference” and “left reference” are the information of theadjacent macro blocks MB already processed and therefore have knownvalues.

When macro blocks MB are processed one after another in raster scanorder, if pixels contacting the left edge of a macro block MB beingprocessed are changed pixels such as those indicated by the full circlesin FIG. 37A, these pixels must be encoded as changed pixels. This isextremely redundant information compared to information encoded in unitsof frames.

To eliminate this redundancy, therefore, in the present invention achange of pixels on the left edge of the macro block MB from the valueof “left reference” on the same line is detected and the first changedpixel having a color opposite to “pred_color” in a reference region isdefined as “b1”. Consequently, the changed pixels are those in positionsindicated by the full circles in FIG. 37B, and this greatly reducesredundant changed pixels compared to the case shown in FIG. 37A.“pred_color” includes “a0_color” (previous line) and “ref_color”(current line).

The “current line” is a line to which the starting changed pixel “a0”belongs, and the “previous line” is a line one line above the “currentline”. “a0_color” is the value (black or white (a black value or a whitevalue)) of the starting changed pixel “a0”, and “ref_color” is the valueof “left reference” on the same line as “current line”.

The “top reference” indicates pixels in contact with the upper edge ofthe macro block MB shown in FIG. 37B. “left reference” indicates pixelsin contact with the left edge of the macro block MB in FIG. 37B.

In a case where a square region including the object is to be encoded,if the upper or the left edge of the macro block MB is in contact withthe upper or the left end of the square region, all values of “topreference” and “left reference” are “white”.

In each of the first to fourth embodiments, the method of predicting achange of the relative address by using the reproduced values of aplurality of lines is described. If this is the case, it is necessary tostore “top reference” and “left reference” of a plurality of lines. Itis also possible to sequentially encode the macro blocks MB from the onein the lower right corner. In this case the reproduced values contactingthe lower and the right edges of the macro block MB are used.

When motion compensation prediction is applied, the motion compensationprediction circuits 110 and 350 in the arrangements shown in FIGS. 2 and3 can generate a motion compensation predictive value for an alpha-mapsignal as well as for a picture signal. Since identical signals needonly be obtained for each of “top reference” and “left reference” on thetransmitter and receiver sides, motion compensation predictive valuescan be used as “top reference” and “left reference”. Also, as describedin the first to fourth embodiments, relative address encoding withrespect to motion compensation predictive values can be applied.

The foregoing is an example of the processing in which macro blocks MBare compression-encoded one after another in raster scan order anddecoded in raster scan order (order of x-direction scan in x-y scan).However, when macro blocks MB are compression-encoded and decoded oneafter another, the compression processing can be performed moreefficiently, depending on the state of a picture, when performed in thevertical direction (in order of y-direction scan in x-y scan) than whenperformed in raster scan order. Therefore, it is useful to realize amethod capable of selectively performing processing in raster order orin the vertical direction in accordance with the state of a picture.This method will be described below as the sixth embodiment.

The sixth embodiment of the present invention will be described belowwith reference to FIGS. 38A to 38D. System configurations required inthis embodiment can also be basically the same as the configurationsshown in FIGS. 2 and 3. That is, it is only necessary to design thesystem such that encoding is performed by the alpha-map encoder 200shown in FIG. 2 and decoding is performed by the alpha-map decoder 400shown in FIG. 3.

FIG. 38B shows the scan order (scan from the left to the right(horizontal scan Sh)) in the first to fifth embodiments. FIG. 38A showsan example of changed pixels (pixels indicated by the full circles)detected by scan in this scan order. In this case twelve changed pixelsare detected even by the use of the changed pixel detection method inthe fifth embodiment. In this embodiment, therefore, as shown in FIG.38D, changed pixels are detected in order of longitudinal scan (scanfrom the top to the bottom (vertical scan Sv)) by switching the rowaddresses and column addresses in the macro block MB. Consequently, thenumber of changed pixels detected is reduced from 12 in the scan methodof FIG. 38B to 8 as shown in FIG. 38C. In this way the number of changedpixels can be reduced by changing the scan direction depending on thestate of a picture.

In the present invention, the amount of generated codes is reduced whenthe number of changed pixels is reduced for the same change amountbetween changed pixels. Therefore, the generated code amount in the scanorder shown in FIG. 38D is smaller than that in FIG. 38B.

Accordingly, the code amount can sometimes be reduced by adaptivelyswitching the scan order in FIG. 38B and the scan order in FIG. 38D. Ifthis is the case, to allow the decoding side to reconstruct data, it isnecessary to encode and add information identifying the scan order tothe data. On the basis of this information identifying the scan order,decoding is performed while the directions are switched.

As described above, when macro blocks MB are compression-encoded anddecoded one after another, the compression encoding can sometimes beperformed more efficiently when performed in the vertical direction (inorder of y-direction scan in x-y scan) than when performed in rasterscan order, depending on the state of a picture. Therefore, the aboveembodiment realizes a system capable of selectively performing theprocessing in raster scan order or in the vertical direction inaccordance with the state of a picture.

It is, however, in some instances also possible to reduce the amount ofcodes by processing macro blocks MB, as square blocks, after rearrangingthem into wide rectangular blocks, instead of directly processing themin the form of a square block. This method will be described below asthe seventh embodiment.

The seventh embodiment of the present invention will be described belowwith reference to FIGS. 39A to 39C. System configurations required inthis embodiment can also be basically the same as the configurationsshown in FIGS. 2 and 3. It is only necessary to design the system suchthat encoding is performed by the alpha-map encoder 200 shown in FIG. 2and decoding is performed by the alpha-map decoder 400 shown in FIG. 3.

In this embodiment, the values of “top reference” and “left reference”in the fifth embodiment are not used in order to independently encodemacro blocks MB.

FIG. 39A is a view for explaining the scan order of this embodiment. Asquare block of n×n pixels constituting the macro block MB as shown onthe left side of FIG. 39A is formed into a raster-scanned rectangularblock by alternately switching the scan directions of lines as shown onthe right side of FIG. 39A. That is, the square block is horizontallyscanned from the upper left pixel to the right along the line (S1). Whenthe right end is reached, the scan moves to pixels on a line below, andthe pixels are horizontally scanned from the right end to the left endalong the line (S2). When the left end is reached, the scan moves topixels on a line below, and the pixels are horizontally scanned from theleft end to the right end along the line (S3). In this manner the scanis performed zigzag. One line is doubled by connecting two scannedlines, i.e., the number of lines is decreased in the vertical direction(column direction), thereby forming a rectangular block. Morespecifically, of the zigzag-scanned lines S1, S2, S3, S4, S5, S6, . . ., the uppermost line is formed by connecting the line S2 to the line S1,the next line is formed by connecting the lines S3 and S4, the next lineis formed by connecting the lines S5 and S6, and so on.

By scanning a square block in this way so that the square block isrearranged into a wide rectangular block, the number of changed pixelsis reduced from 10 in the square block to 5 in the rectangular block inthe case of FIG. 39B.

In this processing, however, the correlation between changed pixels isdecreased. Therefore, if variable length codes designed for squareblocks are used in encoding, the amount of codes is sometimes increased.If this is the case, it is only necessary to newly design rectangularblock variable length codes and prepare them in the form of a table forrectangular blocks and perform encoding by using this rectangular blockvariable length code table.

Also, in a case shown in FIG. 39C, the number of changed pixels remainsunchanged even by the use of this embodiment, as can be seen from thedrawing. On the contrary, the amount of generated codes increases if asquare block is converted into a rectangular block, since thecorrelation between changed pixels is decreased.

Pictures can take various states. Therefore, the amount of generatedcodes can sometimes be reduced by adaptively switching between a squareblock and a rectangular block, and so this embodiment is sufficientlysignificant.

Even in the processing of macro blocks MB, it is in many instancesinefficient to directly compress blocks with the macro block size. Forexample, when every line in a macro block MB assumes the same state of apicture such as when only a vertical belt-like line exists in a picture,data can be faithfully reproduced without decreasing the resolution evenif the data is compressed while lines are thinned. An optimum method fora picture like this will be described below as the eighth embodiment.

The eighth embodiment of the present invention will be described belowwith reference to FIGS. 6, 8, and 40A and 40B. System configurationsrequired in this embodiment can also be basically the same as theconfigurations shown in FIGS. 2 and 3. It is only necessary to designthe system such that encoding is performed by the alpha-map encoder 200shown in FIG. 2 and decoding is performed by the alpha-map decoder 400shown in FIG. 3.

This embodiment solves the problem when the method of encoding a binarypicture after reducing the picture used in the first embodiment isapplied to processing whose unit is a macro block MB.

As described above, an encoder and a decoder can be basically the sameas those used in the first embodiment. In this embodiment, theconfiguration shown in FIG. 6 already described above is used as analpha-map encoder 200, and the configuration shown in FIG. 8 alreadydescribed above is used as an alpha-map decoder 400. Accordingly, theoperations of individual components and the flows of signals arepreviously described in detail in the first embodiment and so a detaileddescription thereof will be omitted.

FIGS. 40A and 40B are views showing examples of reduction of a binarypicture. FIG. 40A shows examples of reduction using the method explainedin the first embodiment. FIG. 40A shows examples of reduction using areduction filter. More specifically, FIG. 40A illustrates reduction inwhich a conversion ratio CR is “1” (the state of no reduction),reduction in which the conversion ratio CR is “1/2” (the state of 1/2reduction), and reduction in which the conversion ratio CR is “1/4” (thestate of 1/4 reduction). Each state shows the result when a square blockis directly thinned in the form of a square block.

FIG. 40B shows examples of reduction in the vertical direction using theline thinning explained in the seventh embodiment. That is, FIG. 40Billustrates reduction in which the conversion ratio CR is “1” (the stateof no reduction), reduction in which the conversion ratio CR is “1/2”(the state of 1/2 reduction), and reduction in which the conversionratio CR is “1/4” (the state of 1/4 reduction). Each state shows theresult when a square block is thinned and converted into a rectangularblock.

The conversion ratio CR is the reduction ratio supplied through the line60 in the alpha-map encoder 200 shown in FIG. 6. In the first embodimentor MMR, if the value of the difference between the addresses of thechanged pixel “b1” and the changed pixel “a1” is a threshold or less, arun with a length (a1−a0) and a run with a length (a2−a1) are encoded(horizontal mode).

Also, since encoding is performed in units of macro blocks MB, the typesof run lengths which can be generated are uniquely determined withrespect to the value of each CR. When a square block is directly reducedin the form of a square block by thinning the data in both thehorizontal and vertical directions as shown in FIG. 40A, the run lengthfrequency distribution greatly changes due to a change in the conversionratio CR. Therefore, the coding efficiency can be improved by performingvariable length encoding in accordance with each CR by preparingvariable length codes for run lengths in accordance with the CR.

When the maximum run length is the number of horizontal pixels in aframe (macro block MB) as in the first embodiment, even a maximum numberof types of run lengths is 17 (0 to 16). Therefore, the load of a memoryfor storing a variable length code table is small even when a pluralityof variable length codes are prepared.

In the example shown in FIG. 40B, since the correlation between changedpixels decreases when the conversion ratio CR is decreased, a variationin the relative address frequency distribution changes in accordancewith a change in the conversion ratio CR. Accordingly, the amount ofgenerated codes can be reduced by optimally switching variable lengthcodes in accordance with CR. Note that even a maximum number of types ofabsolute values of relative addresses is 16 (0 to 15), and so the loadof a memory is small even when a plurality of variable length codetables are prepared.

In the example shown in FIG. 40A, the maximum values of the absolutevalues of the numbers of relative addresses that can be generated aredifferent. Accordingly, the threshold for switching to the horizontalmode can be switched in accordance with CR. Also, the amount of codescan be controlled by adaptively switching the conversion ratios CR orthe reduction methods (e.g., the forms shown in FIGS. 40A and 40B) foreach macro block MB in accordance with the state of a picture.

In the first to eighth embodiments described above, even in alpha-mapcoding performed in units of macro blocks, alpha maps can be encoded anddecoded with no large increase in the amount of codes.

Next, a motion picture transmission system to which a motion picturecoding/decoding apparatus of the present invention is applied will bedescribed below as one application of the invention with reference toFIGS. 41A to 41C.

As shown in FIG. 41A, an input motion picture signal from a camera 1002attached to a personal computer (PC) 1001 is encoded by a motion picturecoding apparatus incorporated into the PC 1001. The output coded datafrom the motion picture coding apparatus is multiplexed with informationof voice or data, transmitted by radio by a radio transceiver 1003, andreceived by another radio transceiver 1004.

The signal received by the radio transceiver 1004 is decomposed into thecoded data of the motion picture signal and the information of voice ordata. The coded data of the motion picture signal is decoded by a motionpicture decoding apparatus incorporated into a workstation (EWS) 1005and displayed on a display of the EWS 1005.

An input motion picture signal from a camera 1006 attached to the EWS1005 is encoded in the same manner as above by a motion picture codingapparatus incorporated into the EWS 1005. The coded data of the motionpicture signal is multiplexed with information of voice or data,transmitted by radio by the radio transceiver 1004, and received by theradio transceiver 1003. The signal received by the radio transceiver1003 is decomposed into the coded data of the motion picture signal andthe information of voice or data. The coded data of the motion picturesignal is decoded by a motion picture decoding apparatus incorporatedinto the PC 1001 and displayed on a display of the PC 1001.

FIG. 41B is a block diagram schematically showing the arrangement of themotion picture coding apparatus incorporated into the PC 1001 and theEWS 1005 shown in FIG. 41A. FIG. 41C is a block diagram schematicallyshowing the arrangement of the motion picture decoding apparatusincorporated into the PC 1001 and the EWS 1005 shown in FIG. 41A.

The motion picture coding apparatus shown in FIG. 41B comprises aninformation source encoder 1102 which is supplied with a picture signalfrom a picture input unit 1101 such as a camera and has an error robustprocessor 1103, and a transmission path encoder 1104. The informationsource encoder 1101 performs discrete cosine transformation (DCT) for aprediction residue signal and quantizes the generated DCT coefficient.The transmission path encoder 114 performs variable length encoding,error detection for coded data, and error correction encoding. Theoutput coded data from the transmission path encoder 1104 is supplied tothe radio transceiver 1105 and transmitted. The processing in theinformation source encoder 1101 and the variable length encoding in thetransmission path encoder 1104 are performed by using the processingmethods explained in the embodiments of the present invention.

The motion picture decoding apparatus shown in FIG. 41C comprises atransmission path decoder 1202 and an information source decoder 1203.The transmission path decoder 1202 is supplied with the coded datareceived by a radio transceiver 1201 and performs processing which isthe reverse of the processing performed by the transmission path encoder1104. The information source decoder 1203 is supplied with the outputsignal from the transmission path decoder 1202 and performs processingwhich is the reverse of the processing performed by the informationsource encoder 1102. The information source decoder 1203 has an errorrobust processor 1204. The picture decoded by the information sourcedecoder 1203 is output by a picture output unit 1205 such as a display.

The decoding operations in these decoders are performed by using theprocessing methods as explained in the embodiments of the presentinvention.

In the present invention, the amount of codes of alpha maps can begreatly reduced. Accordingly, the background and the object can beseparately encoded with no large decrease in the encoding efficiencycompared to conventional encoding methods.

A ninth embodiment for Encoding Motion Vector (MV) for Alpha Map will bedescribed hereinafter.

In the above-described “Second Embodiment”, a method of encoding a videoimage using the correlation between frames has been described in whichthe line of a previous frame is used as a reference line, and thecorrelation between the frames is used to increase the encodingprocessing efficiency. This method is used for processing in units of MBlines (in one line unit in the line direction of a macro block). As isapparent, even with processing in units of MB lines, the generality ismaintained.

An embodiment will be described below in which encoding using thecorrelation between frames is performed in units of macro blocks,thereby increasing the encoding processing efficiency.

In this embodiment, the correlation between a motion compensationprediction (MC) signal of an alpha map and the signal of the MB (macroblock) is evaluated in units of MBs. If the evaluation value is smallerthan a predetermined threshold value, the MC signal is copied to the MB(to be referred to as copy encoding hereinafter). If the evaluationvalue is larger than the threshold value, the MB is encoded using thebinary picture coding method of the present invention.

In performing copy encoding, when the correlation between the “MV(motion vector) of the alpha map” and the “MV (motion vector) of a Y(luminance) signal” is very high, the MV obtained on the basis of the Ysignal is used without any processing. With this operation, copyencoding is enabled without using the amount of codes for the “MV of thealpha map”.

Japanese Patent Application No. 8-116542 discloses an invention in whicha signal obtained by blending an alpha map and a Y signal (thisprocessing is generally referred to as alpha blending) is used to detectan MV (motion vector), thereby detecting a common MV (this MV (motionvector) will be represented as MVYA hereinafter) for the alpha map andthe Y signal.

More specifically, when MC (motion compensation prediction) of the alphamap is performed using the “MVYA” as a common motion vector for thealpha map and the Y signal, no MV information is necessary for copyencoding of the alpha map. That is, the information of the motion vectorof the alpha map is unnecessary in copy encoding of the alpha map.

In this case, however, although the amount of codes of the alpha map isreduced, no optimum MV for the Y signal is detected. Therefore, an MVerror value (the error value of the motion compensation predictionsignal of the alpha map) of the Y signal may increase to decrease theencoding efficiency in the entire encoding system.

This corresponds to a case in which an optimum motion vector MVY for theY signal is detected, or a case in which an optimum motion vector MVAfor the alpha map is detected. In such a case, the encoding efficiencyinevitably decreases.

More specifically, the encoding efficiency may decrease in a case shownin FIG. 42A or 42B. Of these examples, in the case shown in FIG. 42A,the optimum motion vector MVY for the Y signal is detected. Adescription will be made while paying attention to the partial image ofa certain macro block at a certain point of time. A position indicatedby the motion vector MVY for the Y signal, which is detected in theprevious frame, matches a position where the partial image appears inthe subsequent frame. The error evaluation value used here means anerror value in a pixel value contained in an object.

FIG. 42B shows a case in which the optimum motion vector MVA for thealpha map is detected. A description will be made while paying attentionto the contents of the alpha map at a certain macro block at a certainpoint of time. A position indicated by the motion vector MVA for thecontents of the alpha map, which is detected in the previous frame,matches a position where the contents of the alpha map appear in thesubsequent frame. The error value used here means the number ofmismatched pixels of the alpha map.

The vector MVYA is an MV (motion vector) similar to the vector MVArather than the vector MVY. For this reason, comparing to a case inwhich the optimum value MVA is used, the amount of codes of alpha mapencoding rarely increases.

On the other hand, even when the vector “MVY” used as a common MV, copyencoding is not selected because the MC error (motion compensationprediction error) of the alpha map increases, so the alpha map encodingefficiency is not increased.

To solve the above problem, as shown in FIG. 42C, a difference MVDAbetween the optimum motion vector MVA for the alpha map and the optimummotion vector MVY for the luminance signal is obtained, and the obtaineddifference MVDA is efficiently encoded. By calculating the differencebetween the vectors MVA and MVY and encoding the difference, the alphamap encoding efficiency can be increased without decreasing the encodingefficiency of the Y signal (luminance signal).

If the value MVDA as the difference between the vectors MVA and MVY hasa large value, the amount of codes in binary picture encoding of theblock may be smaller than the amount of codes of the motion vector. Inaddition, since the value MVDA is a difference vector from the vectorMVY, the dynamic range is small.

When the maximum value of the search range of the vector MVDA is limitedto be smaller than the search range of the vector MVY, the amount ofcodes of the vector MVDA may be traded off for that in binary pictureencoding. When the search range of the vector MVDA is limited, theencoding table for the vector MVDA is smaller than the encoding tablefor encoding the vector MVY (what is actually encoded is the predictionerror of the vector MVY, and the dynamic range of this prediction erroris twice that of the vector MVY). Therefore, the encoding efficiency isfurther increased by designing a small variable length code table forthe vector MVDA.

To practice the ninth embodiment, the optimum motion vector MVA for thealpha map must be detected. A detailed example of this detectionoperation will be described.

Assume that the vector MVY for the Y signal (the optimum motion vectorfor the Y signal) has already been sent. The vector MVDA correspondingto the difference between the vectors MVA and MVY is detected around aposition indicated by the vector MVY. As described above, copy encodingof the alpha map is executed when the MC error (motion compensationprediction error) of the alpha map becomes smaller than a predeterminedthreshold value. The error is evaluated from the central position to theoutside, and the vector MVDA at a position where the error becomessmaller than the threshold value for the first time is used.

The smallest MVDA is detected and used. Generally, as the value MVDA issmaller, a short code is assigned, so that the vector MVDA isefficiently encoded.

Encoding of the motion vector has been described above. A method ofencoding the attribute information of a macro block in units of framesis also available. This method will be described below as the 10thembodiment. (10th Embodiment).

An embodiment in which the attribute information of each macro block isencoded in units of frames will be described as the 10th embodiment.

FIG. 38 in the sixth embodiment shows the attribute of each block (macroblock MB) in block-based binary picture encoding of the presentinvention. The attribute information of the block (MB) must be encodedindependently of the binary picture encoding information.

FIG. 43A is a view as reillustration of FIG. 38. Referring to FIG. 43A,a macro block indicating only a “white” portion is represented by MBwh,a macro block indicating both the background and the person isrepresented by MBot, and a macro block indicating only a “black” portionis represented by MBbk. The macro block MBwh of only the “white” portionis labeled as “0”, the macro block MBot of both the background and theperson is labeled as “1”, and the macro block MBbk of only the “black”portion is labeled as “3”. FIG. 43A represents block type informationshown in FIG. 43B. The block type information is the attributeinformation of an MB.

There are three labels such as “0”, “1”, and “3”, and each informationcan be expressed by two bits. That is, a decimal digit “0” is expressedby “00” in binary notation; “1”, by “01”; and “3”, by “11”.

Since the block type information can be expressed in two bits, thisinformation can be decomposed into the upper bit (MSB) and the lower bit(LSB), as shown in FIG. 43C. In FIG. 43C, Bpo indicates that theoriginal block type information is (MB attribute information); Bpl, thebit plane of lower bits (LSBs) obtained by decomposing the informationBpo into bit planes; and Bpm, the bit plane of upper bits (MSBs)obtained by decomposing the information Bpo.

Generally, when the block attribute information of the alpha map, whichrepresents whether a block indicates an object, as shown in FIG. 43A, islabeled as in FIG. 43B, and the information is decomposed into the upperand lower bit planes Bpl and Bpm in FIG. 43C, “0” and “1”, tend togather in both the bit planes. That is, the correlation can be kept inboth the MSB and the LSB.

FIG. 44 is a view showing an example in which each bit plane shown inFIG. 43C is encoded by block-based MMR of the present invention. Asshown in FIG. 44, when each bit plane is encoded by highly efficientbinary picture encoding, the amount of codes of the block attributeinformation can be largely reduced as compared to that in encoding inunits of blocks.

In addition, the binary picture encoding method of encoding theattribute of a block is made identical to the binary picture encodingmethod of encoding each block, thereby relaxing the complexity of theentire encoding system.

The detailed example of the method of encoding the block attributeinformation has been described above. Another method of encoding theblock attribute information will be described next.

FIGS. 45A and 45B are views showing examples of the attributeinformation of a certain macro block at time n and at time n-1. As shownin FIG. 42A, a square region is set such that the upper left portion ofthe object contacts the boundary portion of the region. In this case,similar labeling is performed for both the alpha maps of frames in ashort time, like the example of the block attribute information at timen shown in FIG. 45A and the example of the block attribute informationat time n-1 shown in FIG. 45B. The correlation of labeling between theframes is high. Therefore, when the label of the current frame isencoded using the label of a frame which has already been encoded, theencoding efficiency is largely increased.

In some cases, the size of the region at time n is different from thatat time n-1. In this case, with procedures shown in, e.g., FIGS. 46A and46B, the size of the region at time n-1 is made to match that at time n.For example, when the macro block at time n is larger by one row andsmaller by one column than that at time n-1, the rightmost column of themacro block at time n-1 is cut, and thereafter, the lowermost row iscopied to its lower portion to increase the size by one row. FIG. 46B isa view showing this state.

When the macro block at time n-1 is smaller by one column and larger byone row than that at time n, the lowermost row is cut, and thereafter,the rightmost column is copied to its adjacent portion to increase thesize by one column.

When the size changes, the sizes are made to match in this manner. Themethod of matching the sizes is not limited to that described above. Forthe descriptive convenience, the label of the macro block at time n-1whose size is equal to that at time n will be represented as the labelat time n-1′ hereinafter.

FIG. 47A is a view showing the difference between the attributeinformation of the macro block at time n and that at time n-1′, i.e.,the difference between the labels of corresponding pixels. In FIG. 47A,“S” represents that the “labels match each other”, and “D” representsthat the “labels do not match each other”.

FIG. 47B is a view showing the differences between the labels atadjacent pixel positions in the attribute information of the macro blockat time n. For a label at the left end, the difference with respect tothe label at the right-end pixel position one line above the label atthe left end is obtained. For a label at the upper left pixel position,the difference with respect to “0” is obtained. For the descriptiveconvenience, the method shown in FIG. 47A will be referred to asinterframe encoding, and the method shown in FIG. 47B will be referredto as intraframe encoding hereinafter.

As is apparent from FIGS. 47A and 47B, the ratio of “S” in interframeencoding is higher than that in intraframe encoding. Since interframeencoding can perform prediction at a higher probability, reduction ofthe amount of codes can be achieved.

FIG. 49 is a view showing an example of a variable length encoding tablefor encoding each label.

When a label to be encoded matches the predictive value (interframe: thelabel of the previous frame, intraframe: the adjacent label) (in case of“S”), encoding is performed by one-bit codes. When the label does notmatch the predictive value (in case of “D”), encoding is performed bytwo-bit codes. With this method, the amount of codes can be reduced.

In interframe encoding, the ratio of “S” is high. Therefore, theencoding efficiency can be further increased by encoding a plurality oflabels at once.

FIG. 48 is a view showing an example in which whether all thedifferences between the labels in one line are “S” is represented by aone-bit code. In this case, only the labels of lines where all thedifferences are not “S” are encoded. Therefore, the amount of codes islargely reduced.

When the correlation between frames is extremely small, the encodingefficiency may be lower than that in intraframe encoding. In this case,switching between intraframe encoding using one-bit codes and interframeencoding is enabled such that intraframe encoding can also be performed.The frame which is to be encoded first is subjected to intraframeencoding because it has no label to be referred to, as a matter ofcourse. At this time, no code for switching between interframe encodingand intraframe encoding is needed.

FIGS. 50A and 50B are block diagrams of the system of this embodiment,and the flow of the process will be described with reference to FIGS.50A and 50B.

In FIGS. 50A and 50B, parts enclosed by broken lines are associated withthis embodiment. FIG. 50A shows a coding apparatus comprising an objectregion detector 3100, a block forming circuit 3110, a labeling circuit3120, a block encoder 3130, a label memory 3140, a size changing circuit3150, a label encoder 3160, and a multiplexer (MUX) 3170.

The object region detector 3100 detects, on the basis of an inputalpha-map signal, a square region for a portion including an object inthe alpha-map signal, and outputs the alpha-map signal of the squareregion together with information associated with the size of the squareregion. The block forming circuit 3110 forms macro blocks from thealpha-map signal of the square region. The labeling circuit 3120determines the attributes (MBwh (only white), MBot (mixture of white andblack), and MBbk (only black)) of the alpha-map signal contents in themacro blocks in units of blocks of the alpha-map signal which has beendivided into macro blocks, and assigns a label (“0”, “1”, or “3”)corresponding to each attribute.

For a macro block with label “1” (MBot), the block encoder 3130 encodesthe alpha-map signal in the macro block. The label memory 3140accumulates label information supplied from the labeling circuit 3120and region size information supplied from the object region detector3100 through a label memory output line 3020 and also supplies theaccumulated label information and size information to the size changingcircuit 3150.

The size changing circuit 3150 changes the size of the label informationat time n-1 in correspondence with the size at time n, on the basis ofthe label information and size information of the frame at time n-1,which are supplied from the label memory 3140, and the frame sizeinformation at time n, which is supplied from the object region detector3100. The label encoder 3160 encodes the label information supplied fromthe labeling circuit 3120 by using the label information changed in sizeas a predictive value.

The multiplexer 3170 multiplexes the encoded information obtained by thelabel encoder 3160, encoded information supplied from the block encoder3130, and the size information supplied from the object region detector3100 and outputs the information.

In the coding apparatus with this arrangement, the square regionincluding the object is detected by the object region detector 3100 fromthe alpha-map signal supplied through a line 3010. Informationassociated with the size of this square region is output through theline 3020. The alpha-map signal in the region is supplied to the blockforming circuit 3110. The block forming circuit 3110 forms the macroblocks of the alpha-map signal in this region. The alpha-map signaldivided into macro blocks is supplied to the labeling circuit 3120 andthe block encoder 3130.

The labeling circuit 3120 determines the attributes (MBwh, MBot, andMBbk) in units of macro blocks and assigns a label (“0”, “1”, or “3”)corresponding to each attribute. This label information is supplied tothe block encoder 3130, the label memory 3140, and the label encoder3160.

The block encoder 3130 encodes the alpha-map signal in the block whenthe label is “1” (MBot). The encoded information is supplied to themultiplexer 3170. The label memory 3140 accumulates the labelinformation supplied from the labeling circuit 3120 and the region sizeinformation supplied through the label memory output line 3020 andoutputs the label information and size information to the size changingcircuit 3150 through a label memory output line 3030.

The size changing circuit 3150 changes in size the label information atthe time n-1 in correspondence with the size at time n, on the basis ofthe label information and size information of the frame at time n-1,which is supplied through the label memory output line 3030, and thesize information at time n, which is supplied through the line 3020, andsupplies the size-changed label information at time n-1 to the labelencoder 3160. The label encoder 3160 encodes the label informationsupplied from the labeling circuit 3120 by using the label informationsupplied from the size changing circuit 3150 as a predictive value, andsupplies the encoded information to the multiplexer 3170. Themultiplexer 3170 multiplexes the encoded information supplied from theblock encoder 3130 and the label encoder 3160 and the size informationsupplied through the line 3020 and outputs the information through aline 3040.

The arrangement and function of the coding apparatus have been describedabove. The arrangement and function of a decoding apparatus will bedescribed next.

The decoding apparatus shown in FIG. 50B comprises a demultiplexer(DMUX) 3200, a label decoder 3210, a size changing circuit 3220, a labelmemory 3230, and a block decoder 3240. The demultiplexer 3200demultiplexes encoded information supplied through a line 3050. Thelabel decoder 3210 reconstructs the label information at time n by usingthe label information at time n-1, which has been changed in size andsupplied from the size changing circuit 3220.

The size changing circuit 3220 acts like the size changing circuit 3150.The size changing circuit 3220 changes the size of the label informationat time n-1 in correspondence with the size at time n, on the basis ofthe label information and size information of the frame at time n-1,which are supplied from the label memory 3230, and the frame sizeinformation at time n, which is demultiplexed and supplied from thedemultiplexer 3200. The label memory 3230 acts like the label memory3140. The label memory 3230 accumulates the label information decodedand supplied from the label decoder 3210 and the region size informationsupplied from the demultiplexer 3200 and supplies the accumulated labelinformation and size information to the size changing circuit 3220.

The block decoder 3240 reconstructs the alpha-map signal in units ofblocks in accordance with the reconstructed label information suppliedfrom the label decoder 3210.

The function of the decoding apparatus with the above arrangement willbe described. The demultiplexer 3200 demultiplexes the encodedinformation supplied through the line 3050 and supplies the informationto the block decoder 3240 and the label decoder 3210, and at the sametime, outputs the size information through a line 3060. The labeldecoder 3210 reconstructs the label information at time n by using thelabel information at time n-1, which has been changed in size andsupplied from the size changing circuit 3220, as a predictive value.

The reconstructed label information is supplied to the block decoder3240 and the label memory 3230. The block decoder 3240 reconstructs thealpha-map signal in units of blocks in accordance with the reconstructedlabel information supplied from the label decoder 3210. The sizechanging circuit 3220 and the label memory 3230 perform the sameoperations as those of the size changing circuit 3150 and the labelmemory 3230, respectively, and a detailed description thereof will beomitted.

The coding apparatus which assigns labels to the alpha map in units ofmacro blocks and encodes the labels of the macro blocks of the currentframe by using the labels of the macro blocks of an already encodedframe, and the decoding apparatus have been described above. Similarlabels are assigned to the macro blocks of alpha maps in frames close toeach other along the time axis. In such a case, the correlation oflabels between the frames is high. When the labels of the alreadyencoded frame are used to encode the labels of the current frame, theencoding efficiency can be largely increased.

An encoding system using vector quantization will be described as the11th embodiment. In this embodiment, to efficiently encode an alpha map,the alpha map is divided into square blocks, and encoding is performedin units of blocks. A reference pattern extracted from part of analready encoded block is used to generate an index table for vectorquantization in units of blocks. The index table is used to encode thealpha map by vector quantization.

FIG. 51 is a block diagram showing a detailed example of an encoder ofthe present invention, which uses vector quantization. This encodercomprises a memory 1605, a vector quantizer 1607, an index tablegenerator 1609, and a vector inverse quantizer 1613.

The memory 1605 holds an alpha map whose already encoded portion isdecoded. The index table generator 1609 generates an index table 1612 ofvarious pixel patterns on the basis of the information held in thememory 1605. In this table, each pixel pattern of a plurality of macroblocks is made to correspond to an index number. The vector quantizer1607 obtains, on the basis of an input alpha-map signal 1606 and theindex table 1612 output from the index table generator 1609, an index1614 of one of the pixel patterns in the index table 1612, which has asmall error with respect to the alpha-map signal 1606. The vectorquantizer 1607 outputs the index 1614.

The vector inverse quantizer 1613 obtains a pixel pattern correspondingto the index 1614 by using the index 1614 output from the vectorquantizer 1607 and the index table 1612 output from the index tablegenerator 1609, and at the same time, supplies the obtained pixelpattern to the memory 1605 as a decoded alpha map 1615.

The decoder with the above arrangement of the this embodiment isarranged at the portion of the alpha-map encoder 200 of the video codingapparatus shown in FIG. 2. An alpha-map signal is input to this encoder,and the index 1614 obtained upon vector quantization of this alpha-mapsignal is output from the encoder. The alpha-map frame is divided intoblocks, as shown in FIG. 59. The blocks are sequentially encoded in anorder from the upper left block. A region 5-1 indicated by horizontallines is an object region. The portion except for the object region is abackground region 5-2.

FIG. 60 is a view showing an intermediate encoded state of the frame. InFIG. 60, a portion 5-3 enclosed by a thick line represents an alreadyencoded portion, and a block 5-4 is being encoded currently. As shown inFIG. 61, to encode the current block 5-4, adjacent pixel strings areused as a top reference pattern 5-10 and a left reference pattern 5-11.

The pixel values of the top reference pattern 5-10 are represented asT1, T2, . . . , and TB from the left side. The pixel values of the leftreference pattern 5-11 are represented as L1, L2, . . . , and LB fromthe upper side. “B” is the number of pixels (block size) of one side ofthe block.

Referring back to FIG. 51, the encoder of the present inventioncomprises the memory 1605, the vector quantizer 1607, the index tablegenerator 1609, and the vector inverse quantizer 1613. The memory 1605holds an alpha map whose already encoded portion is decoded. Thealpha-map signal 1606 is input to the vector quantizer 1607. Top andleft reference patterns 1608 of the already encoded portion aresequentially read out from the memory 1605 and sent to the index tablegenerator 1609.

On the basis of the reference patterns 1608, the index table generator1609 generates the index table 1612 used for vector quantization(“Multi-dimensional Signal Processing of TV Image”, Nikkan KogyoShinbunsha, 1988, pp. 261-262) and sends the index table 1612 to thevector quantizer 1607 and the vector inverse quantizer 1613.

The index table makes each pixel pattern of the plurality of macroblocks correspond to an index number.

The vector quantizer 1607 obtains the index 1614 of one of the pixelpatterns of the index table 1612 output from the index table generator1609, which has a small error with respect to the alpha-map signal 1606.The index 1614 is also output and sent to the vector inverse quantizer1613.

The vector inverse quantizer 1613 obtains a pixel pattern correspondingto the index 1614 by using the index table 1612. The obtained pixelpattern is sent from the vector inverse quantizer 1613 to the memory1605 as the decoded alpha map 1615.

A detailed example of the index table generator 1609 will be describedreferring to FIGS. 53 to 55.

In the index table generator 1609 having an arrangement shown in FIG.53, when one of prepared types is designated, the index tablecorresponding to the designated type is generated. The index tablegenerator 1609 comprises a type determining section 1616 for designatinga type to be used, a generator 1619 for generating an index table, and amemory 1621 for holding the generated index table.

In the index table generator 1609 having this arrangement, the referencepatterns 1608 are sent to the type determining section 1616.

Several pixel patterns with different tendencies can be selected. When adesired pixel pattern is designated, the type determining section 1616determines to use the designated one of the several prepared types andsends the information of a type 1617 and the information of a parameter1618 to the generator 1619. The generator 1619 generates an index table1620 corresponding to the designated type upon receiving the informationand causes the memory 1621 to temporarily hold the generated index table1620. An index table 1622 is properly output in the encoding process.

FIG. 68 is a flow chart showing the algorithm of processing of the typedetermining section 1616.

S1: First, the type determining section 1616 determines whether thepixel value T1 of the top reference pattern 5-10 described in FIG. 61equals the pixel value L1 of the left reference pattern 5-11. If YES instep S1, the flow advances to step S2; otherwise, the flow advances tostep S4.

S2: The pixel string in the row direction of the macro block is viewedfrom the left side. The first pixel having a value different from theprevious pixel value is represented by RT. The pixel string in thecolumn direction is viewed from the upper side. The first pixel having avalue different from the previous pixel value is represented by RL. When“RT” equals “B” (the number of pixels of one side of the macro block(block size)), and “RL” equals “B”, the flow advances to step S5;otherwise, the flow advances to step S3. The values RT and RL will bedescribed in more detail. The pixel values are sequentially checked inthe order of T1, T2, T3, . . . If a pixel value Tk is different from thevalue T1, RT is represented as k-1. If all the pixel values up to thelast pixel TB in the row direction of the macro block equal the pixelvalue T1, RL=B (“B” is the block size described in FIG. 61). In FIG. 63(B=16), for example, RT=10.

Similarly, “RL” is associated with the pixel values L1, L2, . . . InFIG. 63, RL=6.

S3: When “RT” equals “B”, or when “RL” equals “B”, the flow advances tostep S6; otherwise, the flow advances to step S7.

S4: When “RT” equals “B”, and when “RL” equals “B”, the flow advances tostep S8; otherwise, the flow advances to step S9.

S5: Type M=1. The flow advances to step S10.

S6: Type M=2. The flow advances to step S10.

S7: Type M=3. The flow advances to step S10.

S8: Type M=4. The flow advances to step S10.

S9: Type M=5. The flow advances to step S10.

S10: An index table is prepared on the basis of “M”, “RT”, and “RL”.

When this algorithm is used, the parameters 1618 output from the typedetermining section 1616 in FIG. 53 are RT and RL. The type determiningsection 1616 has an arrangement shown in FIG. 56. The arrangement shownin FIG. 56 comprises a determining section 1623 and an RT/RL detector1624.

The reference patterns 1608 are input to the determining section 1623and the RT/RL detector 1624. The RT/RL detector detects RT and RL, whichare output as the parameters 1618 and also sent to the determiningsection 1623. The determining section 1623 determines the type 1617 onthe basis of the algorithm shown in FIG. 68 and outputs the type 1617.

FIGS. 70A to 70D are views showing examples of the index table using thetype M and RT and RL.

When M=1, all the pixel values of the top reference pattern and the leftreference pattern equal each other. Therefore, several predeterminedindex tables are prepared from pixel patterns without any boundary linecrossing the top and left sides, as shown in FIG. 70A.

In FIG. 70A, a hatched portion has values equal to the pixel value T1.More specifically, when T1 is present in the object region, the hatchedportion indicates the object, and the white portion indicates thebackground. When T1 is present in the background region, the hatchedportion indicates the background, and the white portion indicates theobject.

When M=2, a boundary line crosses the top reference pattern or the leftreference pattern, and all the pixel values of the pattern without anyboundary line equal each other.

FIG. 70B shows examples in which a boundary line crosses the leftreference pattern (RL<B). The boundary line is drawn from the startingpoint, i.e., a point separated from the uppermost point of the left sideby RL, and the angle of the boundary line is changed. When the boundaryline crosses the top reference pattern, the boundary line extends fromthe starting point, i.e., a point separated from the leftmost point ofthe top side by RT.

When M=3, a boundary line crosses the top side and the left side atpoints separated from the upper left corner by RT and RL, respectively,as shown in FIG. 70C.

When M=4, the boundary line is present between T1 and L1. The boundaryline is drawn from the starting point, i.e., the point at the upper leftcorner, as shown in FIG. 70D. When a plurality of lines are used as thetop and left reference patterns, as shown in FIG. 64B, the direction ofthe boundary line can be estimated as indicated by a dotted line in FIG.64A. Therefore, the pixel pattern can be generated using the estimatedboundary line.

FIG. 53 shows the first detailed example of the index table generator1609 as described above. FIG. 54 shows the index table generator 1609.

The index table generator 1609 having an arrangement shown in FIG. 54comprises the type determining section 1616, memories 1625 to 1627, anda switch 1628. This index table generator 1609 generates index tablesaccording to the respective types before the encoding process and storesthe index tables in the memories 1625 to 1627 in units of types. Each ofthe memories 1625 to 1627 exclusively stores an index table.

The switch 1628 selects one of the memories 1625 to 1627 to make use ofthe index table-stored in the selected memory.

In the index table generator 1609 having the above arrangement, the type1617 is determined by the type determining section 1616 on the basis ofthe reference patterns 1608, as in the example shown in FIG. 53. In thesecond example, however, the parameter 1618 is not output from the typedetermining section 1616. The index tables formed according to therespective types before the encoding process are held in the differentmemories 1625 to 1627.

The switch 1628 is changed over in accordance with the type 1617, andthe index table 1622 according to the type 1617 is output.

In the second example, although a lot of memories are needed unlike theexample shown in FIG. 53, calculation for generating indices isunnecessary.

Still the arrangement of the third example of the index table generator1609 will be described below.

FIG. 55 is a block diagram showing the third example of an index tablegenerator comprising an evaluating section 1629, a memory 1630, a switch1632, and a memory 1634. The third example performs no typedetermination unlike the above examples. Instead, an evaluation valuerepresenting the degree of continuity of the boundary lines of referencepatterns and a predetermined pixel pattern is obtained and used.

As shown in FIG. 65B, the pixel values T1, T2, . . . of the topreference pattern are compared with pixel values H1, H2, . . . of thepixel pattern at the upper end, and the pixel values L1, L2, . . . ofthe left reference pattern are compared with pixel values V1, V2, . . .of the pixel string at the left end. The sum of the number of i={1, 2,3, . . . , B} which satisfies Ti=Hi and the number of j={1, 2, 3, . . ., B} which satisfies Lj=Vj is obtained as an evaluation value.

In FIG. 65A, Ti=Hi and Lj=Vj are satisfied when i=1, 2, 3, and j=1, 2,3, 6, 7, 8. Therefore, the evaluation value is “9”.

Referring back to FIG. 55, the memory 1630 holds various pixel patternsin advance, including those shown in FIGS. 70A to 70D. The evaluatingsection 1629 obtains the evaluation value representing the degree ofcontinuity of the boundary lines of the reference patterns and a pixelpattern (supplied from the memory 1630). The switch 1632 controls anoutput from the memory 1630. The memory 1634 holds information suppliedthrough the switch 1632. The switch 1632 is opened/closed in accordancewith an opening/closing signal output from the evaluating section 1629in correspondence with the evaluation value.

The reference patterns 1608 read out from the memory 1605 as one of theconstituent elements of the coding apparatus are sent to the evaluatingsection 1629. Various pixel patterns 1631 held in advance in the memory1630, including those shown in FIGS. 70A to 70D, are sequentially sentto the evaluating section 1629 and the switch 1632.

The evaluating section 1629 obtains the above-described evaluation valuefor the reference patterns 1608 and the pixel pattern 1631. When theevaluation value is smaller than a predetermined value, the evaluatingsection 1629 sends a switching signal 1633 to the switch 1632 so thatthe switch 1632 is connected.

In this case, the pixel pattern 1631 is recorded in the memory 1634 andset in the index table. When the evaluation value is larger than thepredetermined value, the switching signal 1633 is sent to the switch1632 so that the switch 1632 is disconnected. The pixel pattern 1631 isnot sent to the memory 1634.

When evaluation of a predetermined number of pixel patterns prepared inthe memory 1630 is completed, indices are sequentially added to thepixel patterns recorded in the memory 1634, and the index table 1622 isoutput. The evaluation may be ended when a predetermined number of pixelpatterns are recorded in the memory 1634.

Alternatively, a predetermined number of pixel patterns may besequentially selected from those in the memory 1630 in the order ofdecreasing the evaluation value. In this case, the predetermined numberof pixel patterns 1631 and their evaluation values are recorded in thememory 1634.

When the evaluation value of a pixel pattern which is currently beingevaluated is larger than the smallest one of the recorded evaluationvalues, the two pixel patterns may be exchanged.

In the example shown in FIG. 55, although the relatively large memory1630 is needed, calculation for type determination is advantageouslyunnecessary.

Of the examples shown in FIGS. 53 to 55, an appropriate arrangement maybe employed in accordance with the allowance for calculation and memorycapacity in the application system.

The index table generator 1609 shown in FIG. 51 has been describedabove.

FIG. 69 is a flow chart showing the algorithm of the vector quantizer1607 shown in FIG. 51. C(i) represents the allowance condition of theerror of the original image of an input alpha map and a pixel pattern.For example, a block consisting of B×B pixels is “divided into 16, i.e.,(B/4)×(B/4) pixel blocks (FIG. 66), and the sum of the absolute valuesof the errors of the respective pixels of the original image and a pixelpattern i does not exceed α, where α is a threshold value. The sum ofthe absolute values of the errors of the respective pixels correspondsto the number of mismatched pixels. In other words, α is determined suchas 0 pixel, one pixel, two pixels, . . . , B2/16 pixels.

Unless this condition is satisfied, the pixel pattern is not selected.In addition, “E” is the sum of the absolute values of the errors of theB×B pixels as a whole. The flow chart shown in FIG. 69 will bedescribed.

S11: The index is set as i=0. The flow advances to step S12.

S12: If the pixel pattern i satisfies C(i), the flow advances to stepS15; otherwise, the flow advances to step S13.

S13: The index is set as i=1.

S14: If the pixel pattern i satisfies C(i), the flow advances to stepS15; otherwise, the flow advances to step S16.

S15: Mini=i. The flow advances to step S23.

S16: A sufficiently large value is substituted into MinE, therebysetting Mini=1. The flow advances to step S17.

S17: (i+1) is substituted into i. The flow advances to step S18.

S18: If the pixel pattern i satisfies C(i), the flow advances to stepS19; otherwise, the flow advances to step S21.

S19: If E is smaller than MinE, the flow advances to step S20;otherwise, the flow advances to step S21.

S20: E is substituted into MinE, thereby setting Mini=i. The flowadvances to step S21.

S21: If i equals a last value N of the index, the flow advances to stepS22; otherwise, the flow returns to step S17.

S22: If Mini=−1, no index is determined for the block, and theprocessing is ended; otherwise, the flow advances to step S23.

S23: Mini is output as the index for the block, and the processing isended.

In this algorithm, the pixel pattern “0” or the pixel pattern “1” isdetermined immediately when C(i) is satisfied, without calculating “E”.

With this arrangement, when a code shorter than other indices isassigned to the index of the pattern “0” or “1”, the amount of codes canbe reduced. For example, a pixel pattern of a block corresponding to anobject region, or a pixel pattern of a block corresponding to abackground region is assigned to “0” or “1”.

For a block where no index is determined, another encoding method otherthan vector quantization (VQ) may be used to encode the block, as shownin the flow chart of FIG. 67A.

In the flow chart of FIG. 67A, the block for which no index isdetermined is encoded by vector quantization (VQ) first (S24). If anindex is determined, the processing is ended (S25). Otherwise, the flowadvances to step S26. In step S26, encoding is performed by MMR, and theprocessing is ended.

In a case of using an inter mode of performing coding by copying aprediction signal motion-compensated every small region, the encoding isperformed in accordance with the flow chart of FIG. 67B. In other words,the block is encoded by the inter coding method. When the block encodedby the inter coding method is used, the processing is ended. When it isnot used, the block is coded by the vector quantization.

FIG. 71A is a block diagram showing a coding apparatus for performingthe processing based on the flowchart of FIG. 67A. The coding apparatusshown in FIG. 71A comprises a vector quantizer 1642, an MMR encoder1643, a switching section 1644, and a multiplexer 1646. In this codingapparatus, the alpha-map signal 1606 is input to the vector quantizer1642 and the MMR encoder 1643. The vector quantizer 1642 has the samearrangement as shown in FIG. 51. The index 1614 as an output from thevector quantizer 1642 is sent to the switching section 1644.Simultaneously, a switching signal 1645 is sent to the switching section1644 and the multiplexer 1646.

The MMR encoder 1643 encodes the alpha-map signal 1606 by MMR, so thatan MMR code 1647 is sent to the switching section 1644. The switchingsection 1644 receives the MMR code 1647 as an output from the MMRencoder 1643 and the index 1614 as an output from the vector quantizer1642. The switching section 1644 is switched in accordance with theswitching signal 1645 so that one of the MMR code 1647 and the index1614 is selected.

The switching signal 1645 supplied to the switching section 1644 isoutput from the MMR encoder 1643. The MMR encoder 1643 operates suchthat, as an alpha-map code 1648, the index 1614 is selected when theindex 1614 is determined or the MMR code 1647 is selected when no indexis determined.

The index 1614 or the alpha-map code 1648 selected and output from theswitching section 1644 is sent to the multiplexer 1646 for multiplexingthe signal. The multiplexer 1646 multiplexes the index 1614 or thealpha-map code 1648 with the switching signal 1645 obtained from thevector quantizer 1642 and outputs the signal as a code 1649.

In this example, when MMR is selected, the decoded alpha map 1615 of theblock is sent from the MMR encoder 1643 to the memory 1605 in the vectorquantizer. A detailed example of the MMR encoder 1643 will be describedhereinafter.

FIG. 71B is a block diagram showing a coding apparatus for performingthe processing based on the flowchart of FIG. 67B. This coding apparatusfurther includes an inter encoder 1661 and a determining circuit 1662for determining which the inter encoder 1661 or the vector quantizer1642 should be employed. The switching section 1644 is switched by theoutput of the determining circuit 1662 in accordance with the table ofFIG. 71C. In other words, when the determining circuit 1662 receives thesignal S1 of the inter encoder 1661, it turns on the switch n1 to inputthe inter-encoded signal to the multiplexer 1646. When the determiningcircuit 1662 receives the signal S2 of the vector quantizer 1642, itturns on the switch n2 to input the vector-quantized signal to themultiplexer 1646. When the signals S1 and S2 are not output, it turns onthe switch n3 to input the MMR coded signal to the multiplexer 1646.

The MMR encoder 1643 is described in detail hereinafter.

FIG. 74A is a view showing the relationship between changing pixels inencoding in units of blocks. FIG. 74B is a view showing a reference areafor detecting a pixel b1.

In MMR encoding, i.e., block-based encoding, encoding of changing pixelsmay be simplified. The following processing may be performed by changingthe scan order, as in the sixth embodiment, or may be applied to reducedblocks, as in the eighth embodiment.

Simplified changing pixels are encoded in the following manner.

Assume that the addresses of changing pixels ai (i=0 to 1) and b1 fromthe upper left corner of the frame are represented by abs_ai (i=0 to 1)and abs_b1. Values r_ai (i=0 to 1) and r_b1 are obtained by thefollowing equations:r−a 0=abs_(—) a 0−(int)(abs_(—) a 0/WIDTH)*WIDTHr−a 1=abs_(—) a 0−(int)(abs_(—) a 0/WIDTH)*WIDTH*WIDTHr−b 1=abs_(—) a 0−(int)(abs_(—) a 0/WIDTH)*WIDTH

In the above equations, “*” means multiplication, “(int)(x)” meansrounding off the digits after the decimal point of x, and “WIDTH” is thenumber of pixels in the horizontal direction of the block.

When encoding the value “r_a1−r_b1” or “r_a1−r_a0”, a reproduced valuecan be obtained.

FIG. 75 is a flow chart of block-based encoding by MMR. The encodingprocess will be described in accordance with this flow chart. First, theposition of the starting changing pixel is initialized (S501). The pixelvalue at the initial position (the upper left pixel of the block) isencoded by one-bit codes (S502). At the initial position, the referencechanging pixel b1 is detected (S503).

If the changing pixel b1 is not detected, the vertical mode cannot beused because no changing pixel is present in the reference area.Therefore, the vertical pass mode is set to “TRUE”. When the changingpixel b1 is detected, the vertical mode can be used, so that thevertical pass mode is set to “FALSE”.

Setting of the initial state is ended, and the process shifts to theencoding loop process.

The changing pixel a1 is detected (S505). It is determined whether thechanging pixel a1 is detected (S506). If NO in step S506, the end code(EOMB) of the encoding process, which represents the end of encoding, isencoded (S507) because no changing pixel is present anymore.

If YES in step S506, the vertical pass mode is determined (S508). If thevertical pass mode is “TRUE”, encoding in the vertical pass mode isperformed (S516). If the vertical pass mode is “FALSE”, the changingpixel b1 is detected (S509).

It is determined whether the changing pixel b1 is detected (S510). If NOin step S510, the flow advances to the step of the horizontal mode(S513). If YES in step S510, it is determined whether the absolute valueof “r_a1−r_b1” is larger than a threshold value (VTH) (S511). If NO instep S511, the flow advances to the step of the vertical mode (S512). IfYES in step S511, the flow advances to the step of the horizontal mode(S513).

In the step of the horizontal mode (S513), the value “r_a1−r_a0” isencoded. It is determined whether the value “r_a1−r_a0” is smaller than“WIDTH” (S514). If NO in step S514, the vertical pass mode is set to.“TRUE” (S515), and the flow advances to the step of the vertical passmode (S516). Upon completion of the step of the vertical pass mode(S516), the vertical pass mode is set to “FALSE”.

After one of the vertical mode, the horizontal mode, and the verticalpass mode is ended (after encoding up to the pixel a1 is ended), theposition of the pixel a1 is set as the position of the next pixel a0(S518), and the flow returns to step S505.

FIG. 73 shows an example of a VLC table.

When the vertical pass mode is “TRUE”, there are only three codes, i.e.,V0, H, and EOMB. In accordance with the vertical pass mode, the VLC canbe switched. When the vertical pass mode is “TRUE”, the code EOMB isgenerated only when the changing pixel a0 is present at the upper leftposition (initial position) of the block. In this case, the code of “0”in FIG. 73 is used.

When not vector quantization but only MMR encoding is used, theabove-described example may be directly applied to the alpha-map encoder200 shown in FIG. 2.

In addition to the encoding method such as MMR, a block for which noindex is determined can be encoded by a method in which the macro blockis redivided into small blocks, and vector quantization is performedagain, as shown in FIG. 62. In FIG. 62, a macro block of a standard sizeis further divided into small blocks each having a size b=B/2.

In this case, encoding is performed in the order of “A B C D” or “A C BD” such that the reference portion of each block can be encoded first.

Redivision of the block is performed until the error falls within theallowance. With this operation, the number of indices increases toincrease the amount of codes accordingly. However, the error can besuppressed within the allowance.

The detailed example of the coding apparatus has been described above.Finally, the flow chart of the coding apparatus as a whole is shown inFIG. 57.

S27: An index table is generated in accordance with reference patterns.

S28: Vector quantization is performed using the generated index table,and the processing is ended.

The processing is performed in the above manner.

FIG. 52 is a block diagram showing a detailed example of a decodingapparatus. The circuit shown in FIG. 52 comprises a vector inversequantizer 1636 for performing vector inverse quantization, a memory 1637for holding information obtained upon vector inverse quantization, andan index table generator 1639 for generating an index table. Thiscircuit is arranged at the portion of the alpha-map decoder 400 in thevideo decoding apparatus shown in FIG. 3.

An index 1635 is input to the vector inverse quantizer 1636. The memory1637 holds an already decoded alpha map, and a reference pattern 1638 issent from the memory 1637 to the index table generator 1639. The indextable generator 1639 is the same as that of the coding apparatus.

A generated index table 1640 is sent to the vector inverse quantizer1636. A decoded alpha map 1641 is sent from the vector inverse quantizer1636 to the memory 1637.

FIG. 58 is a flow chart showing the flow of the process of the decodingapparatus shown in FIG. 52. This flow chart will be described. The indextable generator 1639 generates an index table in accordance withreference patterns (S29). The vector inverse quantizer 1636 performsvector inverse quantization of the index 1635 by using the generatedindex table (S30), and the processing is ended.

FIG. 72A shows a decoding apparatus for decoding a code generated by thecoding apparatus shown in FIG. 71A. This decoding apparatus comprises ademultiplexer 1651 for demultiplexing a signal obtained by multiplexinga switching signal 1652 with an alpha-map code 1653, a switching section1655 for switching the circuit in accordance with the switching signal1652 demultiplexed by the demultiplexer 1651 to input a signal to avector inverse quantizer 1654 or an MMR decoder 1657, the vector inversequantizer 1654 for performing vector inverse quantization of thealpha-map code 1653 demultiplexed by the demultiplexer 1651 and suppliedthrough the switching section 1655, and a switching section 1656 forswitching the circuit in accordance with the switching signal 1652 tooutput a signal from the vector inverse quantizer 1654 or the MMRdecoder 1657.

In this arrangement, a code 1650 as the multiplexed signal of theswitching signal 1652 and the alpha-map code 1653 is input to thedemultiplexer 1651. The demultiplexer 1651 demultiplexes the code 1650into the switching signal 1652 and the alpha-map code 1653. Theswitching signal 1652 is sent to the switching sections 1655 and 1656.The alpha-map code 1653 is sent to the switching section 1656.

The switching section 1656 sends the alpha-map code 1653 to the vectorinverse quantizer 1654 or the MMR decoder 1657 in accordance with theswitching signal 1652. Upon receiving the alpha-map code 1653, thevector inverse quantizer 1654 or the MMR decoder 1657 reconstructs analpha map 1658. The alpha map 1658 is output through the switchingsection 1655.

FIG. 72B shows a decoding apparatus for decoding a code generated by thecoding apparatus shown in FIG. 71B. In the decoding apparatus, an interdecoder 1663 is added to the decoding apparatus of FIG. 72A. Accordingto the decoding apparatus, when the code 1650 as the multiplexed signalof the switching signal 1652 and the alpha-map code 1653 isdemultiplexed by the demultiplexer 1651, the switching signal 1652 issent to the switching sections 1655 and 1656 and the alpha-map code 1653is sent to the switching section 1656.

The switching section 1656 sends the alpha-map code 1653 to the vectorinverse quantizer 1654, the MMR decoder 1657 or the inter decoder 1663in accordance with the switching signal 1652. Upon receiving thealpha-map code 1653, the vector inverse quantizer 1654, the MMR decoder1657 or the inter decoder 1663 reconstructs an alpha map 1658. The alphamap 1658 is output through the switching section 1655.

The detailed example of the decoding apparatus as the 11th embodimenthas been described above.

As has been described above, according to the present invention, thealpha map can be efficiently encoded. Since the amount of codes of thealpha map can be reduced, the background and the object can beindependently encoded without largely decreasing the encodingefficiency.

Although various embodiments have been described above, the presentinvention is not limited to the above embodiments, and various changesand modifications can be made.

According to the present invention, since the amount of codes of thealpha map can be reduced, the background and the object can beindependently encoded without largely decreasing the encodingefficiency, unlike the conventional encoding method.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details, representative devices, andillustrated examples shown and described herein. Accordingly, variousmodifications may be made without departing from the spirit or scope ofthe general inventive concept as defined by the appended claims andtheir equivalents.

1. A picture data signal for transmitting encoded picture information,the picture data signal comprising: an encoded picture stream includinga code string having, coded alpha-map data indicating an alpha-mapsignal of a rectangular region containing an object and a part of abackground surrounding the object, and coded position/size dataindicating a position and a size of the rectangular region; and codedpicture data indicating a picture signal of the rectangular regioncontaining the object.
 2. The picture data signal according to claim 1,wherein the coded position/size data includes an address of a corner ofthe rectangular region and dimensions thereof in horizontal and verticaldirections.
 3. The picture data signal according to claim 1, wherein therectangular region comprises a plurality of blocks, each of which is aprocessing unit for transmitting the picture information.
 4. The picturedata signal according to claim 1, wherein the rectangular regionincludes an integral number of blocks, each of which is a processingunit for transmitting.
 5. The picture data signal according to claim 1,wherein the alpha-map signal includes information for discriminatingbetween the object and the background in accordance with a binary “0” or“1”.